EF-Train: Enable Efficient On-device CNN Training on FPGA through Data Reshaping for Online Adaptation or Personalization
Open Access
- 6 June 2022
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Design Automation of Electronic Systems
- Vol. 27 (5) , 1-36
Abstract
Conventionally, DNN models are trained once in the cloud and deployed in edge devices such as cars, robots, or unmanned aerial vehicles (UAVs) for real-time inference. However, there are many cases that require the models to adapt to new environments, domains, or users. In order to realize such domain adaption or personalization, the models on devices need to be continuously trained on the device. In this work, we design EF-Train, an efficient DNN training accelerator with a unified channel-level parallelism-based convolution kernel that can achieve end-to-end training on resource-limited low-power edge-level FPGAs. It is challenging to implement on-device training on resource-limited FPGAs due to the low efficiency caused by different memory access patterns among forward and backward propagation and weight update. Therefore, we developed a data reshaping approach with intra-tile continuous memory allocation and weight reuse. An analytical model is established to automatically schedule computation and memory resources to achieve high energy efficiency on edge FPGAs. The experimental results show that our design achieves 46.99 GFLOPS and 6.09 GFLOPS/W in terms of throughput and energy efficiency, respectively.Keywords
All Related Versions
This publication has 30 references indexed in Scilit:
- DeepTypeProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2018
- DNNBuilder2018
- Caffeine: Toward Uniformed Representation and Acceleration for Deep Convolutional Neural NetworksIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2018
- Scaling Human Activity Recognition via Deep Learning-based Domain Adaptation2018
- Angel-Eye: A Complete Design Flow for Mapping CNN Onto Embedded FPGAIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2018
- An FPGA-based processor for training convolutional neural networks2017
- AlphaGo, Deep Learning, and the Future of the Human MicroscopistArchives of Pathology & Laboratory Medicine, 2017
- FP-DNN: An Automated Framework for Mapping Deep Neural Networks onto FPGAs with RTL-HLS Hybrid Templates2017
- Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks2015
- A More Realistic Thinning Scheme for Call Admission Control in Multimedia Wireless NetworksIEEE Transactions on Computers, 2008