Fast Yet Accurate Timing and Power Prediction of Artificial Neural Networks Deployed on Clock-Gated Multi-Core Platforms
Open Access
- 17 January 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 79-86
Abstract
When deploying Artificial Neural Networks (ANNs) onto multi-core embedded platforms, an intensive evaluation flow is necessary to find implementations that optimize resource usage, timing and power. ANNs require indeed significant amounts of computational and memory resources to execute, while embedded execution platforms offer limited resources with strict power budget. Concurrent accesses from processors to shared resources on multi-core platforms can lead to bottlenecks with impact on performance and power. Existing approaches show limitations to deliver fast yet accurate evaluation ahead of ANN deployment on the targeted hardware. In this paper, we present a modeling flow for timing and power prediction in early design stage of fully-connected ANNs on multi-core platforms. Our flow offers fast yet accurate predictions with consideration of shared communication resources and scalability in regards of the number of cores used. The flow is evaluated on real measurements for 42 mappings of 3 fully-connected ANNs executed on a clock-gated multi-core platform featuring two different communication modes: polling or interrupt-based. Our modeling flow predicts timing with accuracy and power with accuracy on the tested mappings for an average simulation time of 0.23 s for 100 iterations. We then illustrate the application of our approach for efficient design space exploration of ANN implementations.Keywords
Funding Information
- Federal Ministry of Education and Research (BMBF, Germany) (Scale4Edge (16ME0465))
- WISE consortium, France (pSSim4AI)
This publication has 9 references indexed in Scilit:
- Frequency-based Power Efficiency Improvement of CNNs on Heterogeneous IoT Computing Systems2020
- An Experimental Study of Reduced-Voltage Operation in Modern FPGAs for Neural Network Acceleration2020
- MAESTRO: A Data-Centric Approach to Understand Reuse, Performance, and Hardware Cost of DNN MappingsIEEE Micro, 2020
- A Design Space Exploration Framework for Convolutional Neural Networks Implemented on Edge DevicesIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2018
- Using Dataflow to Optimize Energy Efficiency of Deep Neural Network AcceleratorsIEEE Micro, 2017
- Power Analysis and Optimization2016
- A Model-Driven Approach for Hybrid Power Estimation in Embedded Systems DesignEURASIP Journal on Embedded Systems, 2011
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Synchronous data flowProceedings of the IEEE, 1987