Soft Error Tolerant Convolutional Neural Networks on FPGAs With Ensemble Learning
- 18 January 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Very Large Scale Integration (VLSI) Systems
- Vol. 30 (3) , 291-302
Abstract
Convolutional neural networks (CNNs) are widely used in computer vision and natural language processing. Field-programmable gate arrays (FPGAs) are popular accelerators for CNNs. However, if used in critical applications, the reliability of FPGA-based CNNs becomes a priority because FPGAs are prone to suffer soft errors. Traditional protection schemes, such as triple modular redundancy (TMR), introduce a large overhead, which is not acceptable in resource-limited platforms. This article proposes to use an ensemble of weak CNNs to build a robust classifier with low cost. To have a group of base CNNs with low complexity and balanced similarity and diversity, residual neural networks (ResNets) with different layers (20/32/44/56) are combined in the ensemble system to replace a single strong ResNet 110. In addition, a robust combiner is designed based on the reliability evaluation of a single ResNet. Single ResNets with different layers and different ensemble schemes are implemented on the FPGA accelerator based on Xilinx Zynq 7000 SoC. The reliability of the ensemble systems is evaluated based on a large-scale fault injection platform and compared with that of the TMR-protected ResNet 110 and ResNet 20. Experiment results show that the proposed ensembles could effectively improve the system reliability when suffering soft errors with an overhead much lower than TMR.Keywords
Funding Information
- National Natural Science Foundation of China (62171313)
- NSFC Joint Foundation (20200509)
- ACHILLES Project (PID2019-104207RB-I00)
- Go2Edge Network (RED2018-102585-T)
- Department of Research and Innovation of Madrid Regional Authority with the EMPATIA-CM Research Project (Y2018/TCS-5046)
This publication has 43 references indexed in Scilit:
- Angel-Eye: A Complete Design Flow for Mapping CNN Onto Embedded FPGAIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2018
- Fault and Error Tolerance in Neural Networks: A ReviewIEEE Access, 2017
- SEU susceptibility analysis of a feedforward neural network implemented in a SRAM-based FPGA2017
- Minerva: Enabling Low-Power, Highly-Accurate Deep Neural Network Accelerators2016
- Deep Residual Learning for Image Recognition2016
- Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology ImagesIEEE Transactions on Medical Imaging, 2016
- Robust Face Recognition via Multimodal Deep Face RepresentationIEEE Transactions on Multimedia, 2015
- Going deeper with convolutions2015
- Using Duplication with Compare for On-line Error Detection in FPGA-based Designs2008
- Algorithm-based fault detection for signal processing applicationsIEEE Transactions on Computers, 1990