Efficient Error Detection for Matrix Multiplication With Systolic Arrays on FPGAs
- 23 February 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computers
- Vol. 72 (8) , 2390-2403
Abstract
Matrix multiplication has always been a cornerstone in computer science. In fact, linear algebra tools permeate a wide variety of applications: from weather forecasting, to financial market prediction, radio signal processing, computer vision, and more. Since many of the aforementioned applications typically impose strict performance and/or fault tolerance constraints, the demand for fast and reliable matrix multiplication (MxM) is at an all-time high. Typically, increased reliability is achieved through redundancy. However, coarse-grain duplication incurs an often prohibitive overhead, higher than 100%. Thanks to the peculiar characteristics of the MxM algorithm, more efficient algorithm-based hardening solutions have been designed to detect (and even correct) some types of errors with lower overhead. We show that, despite being more efficient, current solutions are still sub-optimal in certain scenarios, particularly when considering persistent faults in Field-Programmable Gate-Arrays (FPGAs). Based on a thorough analysis of the fault model, we propose an error detection technique for MxM that decreases both algorithmic and architectural costs by over a polynomial degree, when compared to existing algorithm-based strategies. Furthermore, we report arithmetic overheads at the application level to be under 1% for three state-of-the-art Convolutional Neural Networks (CNNs).Keywords
This publication has 35 references indexed in Scilit:
- Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer LearningIEEE Transactions on Medical Imaging, 2016
- High-Reliability FPGA-Based Systems: Space, High-Energy Physics, and BeyondProceedings of the IEEE, 2015
- A fault injection methodology and infrastructure for fast single event upsets emulation on Xilinx SRAM-based FPGAs2014
- Data-centric HPC for Numerical Weather Forecasting2014
- A concurrent neural network approach to pedestrian detection in thermal imagery2012
- Using Duplication with Compare for On-line Error Detection in FPGA-based Designs2008
- Soft errors in advanced semiconductor devices-part I: the three radiation sourcesIEEE Transactions on Device and Materials Reliability, 2001
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- A comparison of fault-tolerant state machine architectures for space-borne electronicsIEEE Transactions on Reliability, 1996
- Radiation effects on microelectronics in spaceProceedings of the IEEE, 1988