HALF: Holistic Auto Machine Learning for FPGAs
Authors:
- 1 August 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 363-368
Abstract
Deep Neural Networks (DNNs) are capable of solving complex problems in domains related to embedded systems, such as image and natural language processing. To efficiently implement DNNs on a specific FPGA platform for a given cost criterion, e.g., energy efficiency, an enormous amount of design parameters must be considered from the topology down to the final hardware implementation. Interdependencies between the different design layers must be taken into account and explored efficiently, making it hardly possible to find optimized solutions manually. An automatic, holistic design approach can improve the quality of DNN implementations on FPGA significantly. To this end, we present a cross-layer design space exploration methodology. It comprises optimizations starting from a hardware-aware topology search for DNNs down to the final optimized implementation for a given FPGA platform. The methodology is implemented in our Holistic Auto machine Learning for FPGAs (HALF) framework, which combines an evolutionary search algorithm, various optimization steps, and a library of parametrizable hardware DNN modules. HALF automates both the exploration process and the implementation of optimized solutions on a target FPGA platform for various applications. We demonstrate the performance of HALF on a medical use case for arrhythmia detection for three different design goals, i.e., low-energy, low-power, and high-throughput. Our FPGA implementation outperforms a TensorRT optimized model on an Nvidia Jetson platform in both throughput and energy consumption.Keywords
All Related Versions
Funding Information
- Ministry of Education
This publication has 11 references indexed in Scilit:
- Automatically Designing CNN Architectures Using the Genetic Algorithm for Image ClassificationIEEE Transactions on Cybernetics, 2020
- Hardware/Software Co-Exploration of Neural ArchitecturesIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2020
- Regularized Evolution for Image Classifier Architecture SearchProceedings of the AAAI Conference on Artificial Intelligence, 2019
- FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search2019
- Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural networkNature Medicine, 2019
- DNNBuilder2018
- ECG Heartbeat Classification: A Deep Transferable Representation2018
- A genetic programming approach to designing convolutional neural network architectures2017
- FINN2017
- Real-Time Patient-Specific ECG Classification by 1-D Convolutional Neural NetworksIEEE Transactions on Biomedical Engineering, 2015