Extensible Embedded Processor for Convolutional Neural Networks
Open Access
- 21 April 2021
- journal article
- research article
- Published by Wiley in Scientific Programming
- Vol. 2021, 1-12
Abstract
Convolutional neural networks (CNNs) require significant computing power during inference. Smart phones, for example, may not run a facial recognition system or search algorithm smoothly due to the lack of resources and supporting hardware. Methods for reducing memory size and increasing execution speed have been explored, but choosing effective techniques for an application requires extensive knowledge of the network architecture. This paper proposes a general approach to preparing a compressed deep neural network processor for inference with minimal additions to existing microprocessor hardware. To show the benefits to the proposed approach, an example CNN for synthetic aperture radar target classification is modified and complimentary custom processor instructions are designed. The modified CNN is examined to show the effects of the modifications and the custom processor instructions are profiled to illustrate the potential performance increase from the new extended instructions.Keywords
Funding Information
- Bradley University
- Caterpillar
This publication has 13 references indexed in Scilit:
- Performance Modeling for CNN Inference Accelerators on FPGAIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2019
- Energy Consumption Saving in Embedded Microprocessors Using Hardware AcceleratorsTELKOMNIKA (Telecommunication Computing Electronics and Control), 2018
- Mobile high-performance computing (HPC) for synthetic aperture radar signal processing2018
- In-Datacenter Performance Analysis of a Tensor Processing Unit2017
- XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks2016
- Quantized Convolutional Neural Networks for Mobile Devices2016
- SP-CNN: A Scalable and Programmable CNN-Based AcceleratorIEEE Micro, 2015
- Sparse Convolutional Neural Networks2015
- Fixed point optimization of deep convolutional neural networks for object recognition2015
- Data Transfer Matters for GPU Computing2013