Comparative Survey of Embedded System Implementations of Convolutional Neural Networks in Autonomous Cars Applications
Open Access
- 4 December 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 182410-182437
Abstract
In the rapidly evolving field of autonomous cars, advanced deep learning systems have ushered in a new era of innovation, enabling the integration of unique features into vehicles. These advancements span various areas, including pedestrian and vehicle detection, recognition of road signs and driving patterns, identification of drivable roads and scenes, and improved mapping and routing techniques. However, the high computational requirements of deep learning networks present a significant challenge, especially for embedded systems like FPGAs (Field-Programmable Gate Arrays) that have limited capacity. Addressing this challenge, this article presents a comprehensive survey of the methodologies employed in implementing Convolutional Neural Networks (CNNs) on resource-constrained processors, within the domain of self-driving car applications. Our survey encompasses a thorough review of the existing literature in the field of deep learning applied to autonomous cars, from perception to localization, with a specific emphasis on implementations utilizing embedded hardware such as FPGAs and embedded GPUs. Furthermore, we present and analyze results that elucidate the intricate trade-offs between latency, energy consumption, and the judicious selection of the underlying platform. These insights are crucial for researchers and practitioners in the field, as they provide a clear direction for optimizing the performance of deep learning networks on resource-constrained platforms, ultimately contributing to the advancement of self-driving car technologies.Keywords
Funding Information
- SPACE Project–funded by European Union–Next Generation EU within the PRIN 2022 program
- Key Digital Technologies Joint Undertaking under the REBECCA Project (101097224)
- European Union, Greece, Germany, Netherlands, Spain, Italy, Sweden, Turkey, Lithuania, and Switzerland
- Italian ICSC National Research Centre for High-Performance Computing, Big Data and Quantum Computing in the context of the NextGenerationEU Program
This publication has 128 references indexed in Scilit:
- Hardware acceleration of YOLOv7-tiny using high-level synthesis toolsJournal of Real-Time Image Processing, 2023
- M-FasterSeg: An efficient semantic segmentation network based on neural architecture searchEngineering Applications of Artificial Intelligence, 2022
- Public acceptance and perception of autonomous vehicles: a comprehensive reviewAI and Ethics, 2021
- Sleep Deprivation Detection for Real-Time Driver Monitoring Using Deep Learning2018
- Survey on Artificial Intelligence for VehiclesAutomotive Innovation, 2018
- Fully-Convolutional Siamese Networks for Object Tracking2016
- SSD: Single Shot MultiBox Detector2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Random Forests for Real Time 3D Face AnalysisInternational Journal of Computer Vision, 2012
- A Floating-point Extended Kalman Filter Implementation for Autonomous Mobile RobotsJournal of Signal Processing Systems, 2008