An FPGA-based processor for training convolutional neural networks
Authors:
- 1 December 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 207-210
Abstract
Convolutional neural networks (CNNs) have gained great success in various computer vision applications. However, training a CNN model is computation-intensive and time-consuming. Hence training is mainly processed on large clusters of high-performance processors like server CPUs and GPUs. In this paper, we propose an FPGA-based processor design to accelerate the training process of CNNs. We first analyze the operations in all types of CNN layers in the training process. A uniform computation engine design is proposed to efficiently carry out all kinds of operations based on the analysis. Then a scalable accelerator framework is presented that exploits the parallelism further by unrolling the loops in two levels. The proposed accelerator design is demonstrated by implementing a processor on the Xilinx ZU19EG FPGA working at 200 MHz. The evaluation results on a group of CNN models show that our processor is 5.7 to 10.7-fold faster than the software implementations on the Intel Core i5-4440 CPU(@3.10GHz).Keywords
This publication has 11 references indexed in Scilit:
- Improving the Performance of OpenCL-based FPGA Accelerator for Convolutional Neural Network2017
- F-CNN: An FPGA-based framework for training Convolutional Neural Networks2016
- MatConvNet2015
- A discriminative CNN video representation for event detection2015
- Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks2015
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Max-pooling convolutional neural networks for vision-based hand gesture recognition2011
- A dynamically configurable coprocessor for convolutional neural networksACM SIGARCH Computer Architecture News, 2010
- Convolutional face finder: a neural architecture for fast and robust face detectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998