Enhancing matrix multiplication with a monolithic 3-D-based scratchpad memory
- Authors
- Do, C.T.; Choi, J.H.; Lee, Y.S.; Kim, C.H.; Chung, S.W.
- Issue Date
- 6월-2021
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Keywords
- High performance; matrix multiplication; monolithic 3-D; neural network; scratchpad memory (SPM)
- Citation
- IEEE Embedded Systems Letters, v.13, no.2, pp.57 - 60
- Indexed
- SCIE
SCOPUS
- Journal Title
- IEEE Embedded Systems Letters
- Volume
- 13
- Number
- 2
- Start Page
- 57
- End Page
- 60
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/128821
- DOI
- 10.1109/LES.2020.3001954
- ISSN
- 1943-0663
- Abstract
- Convolutional neural networks (CNNs) are one of the most popular machine learning algorithms. The convolutional layers, which account for the most execution time of CNNs, are implemented with matrix multiplication because the convolution operation performs dot products between filters and local regions of the input. On the other hand, GPUs with thousands of cores were proven to significantly accelerate matrix multiplication, compared to CPUs with a limited number of cores, especially for large matrices. However, the current memory architecture allows only one row access at a time so that multiple accesses are necessary to read the column data of the second matrix, thus slowing down matrix multiplication. In this study, we adopt the monolithic 3-D integration for the GPU scratchpad memory, called monolithic 3-D integration (M3D) scratchpad memory (SPM), to enhance matrix multiplication. The M3D SPM allows one access to read the column data of the second matrix, similar to the case of the first matrix. The simulation results show that our M3D SPM improves the system performance by 46.3% for the 32 × 32 matrix multiplication, over the conventional 2-D SPM where the column data of the second matrix are read sequentially. © 2009-2012 IEEE.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - Graduate School > Department of Computer Science and Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.