FlashMAC: A Time-Frequency Hybrid MAC Architecture With Variable Latency-Aware Scheduling for TinyML Systems
- 4 July 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Solid-State Circuits
- Vol. 57 (10) , 2944-2956
Abstract
With the widespread of deep neural networks (DNNs) in diverse applications, tiny platforms such as Internet-of-Things devices are starting to adopt DNNs. Due to their extreme energy and form factor constraints, conventional digital-only implementations of multiply-and-accumulate (MAC) acceleration faced fundamental limitations. To that end, the investigation into mixed-signal computing architectures is growing rapidly. Motivated by the flash ADC, this article proposes FlashMAC architecture that can natively support multibit multiplication. In addition, through fusing time- and frequency-domain computing methods without power-hungry oscillators, it enables low latency accumulation with low power consumption. As a result, the proposed time-frequency hybrid architecture achieves high energy efficiency with the support for complex DNN models requiring higher precision. To enhance the robustness of PVT variation of the mixed-signal architecture, a frequency calibration loop is integrated. In addition, motivated by the data-dependent performance of the FlashMAC architecture, variable latency-aware scheduling is proposed. The FlashMAC does not skip MAC operations as zero-skipping architectures do, but the latency of the operation can be lower when operands are smaller in magnitude. Tackling the issue through software and hardware co-optimization, loose synchronization architecture and magnitude-aware weight reordering increase the DNN benchmark performance by achieving higher utilization of the parallel FlashMAC array. The proposed features are integrated into a test chip which is fabricated in 65-nm logic CMOS technology. The silicon chip achieves 56.52 TOPS/W peak energy efficiency and a peak operating frequency of 90 MHz. Tested with the VGG16 benchmark trained on the Imagenet dataset, it achieved 17.04-ms latency while showing 11.15 TOPS/W energy efficiency. As a result, compared to the previous state-of-the-art, the proposed FlashMAC achieved 3.15 $\times $ higher normalized energy efficiency.Keywords
Funding Information
- Ministry of Science and ICT (MSIT), South Korea, through the Information Technology Research Center
- Institute for Information and Communications Technology Planning and Evaluation (IITP-2020-0-01847)
This publication has 36 references indexed in Scilit:
- Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network2017
- A scalable time-based integrate-and-fire neuromorphic core with brain-inspired leak and local lateral inhibition capabilities2017
- EyerissACM SIGARCH Computer Architecture News, 2016
- Deep Residual Learning for Image Recognition2016
- You Only Look Once: Unified, Real-Time Object Detection2016
- Mastering the game of Go with deep neural networks and tree searchNature, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- DeepFace: Closing the Gap to Human-Level Performance in Face Verification2014
- Future of analog in the VLSI environment2002
- Analog Versus Digital: Extrapolating from Electronics to NeurobiologyNeural Computation, 1998