A Novel DSP Architecture for Scientific Computing and Deep Learning
Open Access
- 18 March 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 36413-36425
Abstract
Exascale computing requires accelerators with ultrahigh power efficiency. Digital signal processors (DSPs), the most important embedded processors widely known for high power efficiency, are rarely explored in the HPC community. We propose a 64-bit general purpose DSP architecture, FT-Matrix2000, which not only integrates main features of DSPs, but also presents several novel enhancements for scientific computing. The FT-Matrix2000 architecture comprises multiple FT-Matrix2 cores and optional RISC CPU cores. The FT-Matrix2 core utilizes a VLIW+SIMD architecture, provides support for double precision operations, and optimizes both the data and control path for scientific computing. Our evaluations show that the performance and efficiency of FT-Matrix2000 are 1107GFLOPS and 92.25%. Compared with the MIC and a 40nm process GPU, FT-Matrix2000 improves the GEMM power efficiency with a factor of 1.49 and 2.68, respectively. We build up a prototype supercomputer with FT-Matrix2000/12. Its HPL efficiency achieves 62.2%, and the performance power ratio is 5.33 GFLOPS/W, which can rank the fourth in the latest Green500 list. These results validate that the FT-Matrix2000 architecture is suitable for scientific computing while maintaining the efficiency of signal processing well. Moreover, the enhancement of FT-Matrix2000 in vector and matrix related computations also enable it to efficiently support deep learning related applications. We have implemented some typical DCNN models on FT-Matrx2000, NVIDIA GPUs and Vision P6 DSP. Experiments demonstrate that the average computation efficiency of the proposed architecture based on Matrix2000 is about 20~35% and 8% higher respectively than GPUs and Cadence Vision P6 DSP.Keywords
Funding Information
- National Natural Science Foundation of China (61602493, 61572025)
This publication has 29 references indexed in Scilit:
- Fuzzy Adaptive Control Design and Discretization for a Class of Nonlinear Uncertain SystemsIEEE Transactions on Cybernetics, 2015
- Accelerating LINPACK with MPI-OpenCL on Clusters of Multi-GPU NodesIEEE Transactions on Parallel and Distributed Systems, 2014
- Anatomy of High-Performance Many-Threaded Matrix Multiplication2014
- CudaDMA2011
- Anatomy of high-performance matrix multiplicationACM Transactions on Mathematical Software, 2008
- Floating-point multiply-add-fused with reduced latencyIEEE Transactions on Computers, 2004
- Multiaccess memory system for attached simd computerIEEE Transactions on Computers, 2004
- Efficient 2D FFT implementation on mediaprocessorsParallel Computing, 2003
- Memory access scheduling2000
- Division and square root: choosing the right implementationIEEE Micro, 1997