Survey of Deep Learning Accelerators for Edge and Emerging Computing
Preprint
- 10 July 2024
- preprint
- Published by MDPI AG in Preprints.org
Abstract
The unprecedented progress in Artificial Intelligence (AI), particularly in deep learning algorithms with ubiquitous internet connected smart devices, has created a high demand for AI computing on the edge devices. This review studied commercially available edge processors, and the processors that are still in industrial research stages. We categorized state-of-the-art edge processors based on the underlying architecture, such as dataflow, neuromorphic, and Processing in-Memory (PIM) architecture. The processors are analyzed based on their performance, chip area, energy efficiency, and application domains. The supported programming frameworks, model compression, data precision, and the CMOS fabrication process technology are discussed. Currently, most of the commercial edge processors utilize dataflow architectures. However, emerging non-von Neumann computing architectures have attracted the industry in recent years. Neuromorphic processors are highly efficient for performing computation with fewer synaptic operations, and several neuromorphic processors offer online training for secured and personalized AI applications. This review found that the PIM processors show significant energy efficiency and consume less power compared to dataflow and neuromorphic processors. The future direction of the industry would be to implement state-of-the-art deep learning algorithms in emerging non-Von Neumann computing paradigms for low power computing on the edge devices.Keywords
All Related Versions
This publication has 102 references indexed in Scilit:
- A comprehensive review of Binary Neural NetworkArtificial Intelligence Review, 2023
- Bringing AI to edge: From deep learning’s perspectiveNeurocomputing, 2022
- A survey of modern deep learning based object detection modelsDigital Signal Processing, 2022
- Pruning and quantization for deep neural network acceleration: A surveyNeurocomputing, 2021
- The analysis of intelligent real-time image recognition technology based on mobile edge computing and deep learningJournal of Real-Time Image Processing, 2020
- Deep Model Compression and Architecture Optimization for Embedded Systems: A SurveyJournal of Signal Processing Systems, 2020
- A Survey of AI Accelerators for Edge Environment2020
- A Survey of Accelerator Architectures for Deep Neural NetworksEngineering, 2020
- Deep learning in spiking neural networksNeural Networks, 2019
- A transfer convolutional neural network for fault diagnosis based on ResNet-50Neural Computing and Applications, 2019