A Robust and Energy-Efficient Control Policy for Autonomous Vehicles with Auxiliary Tasks
Open Access
- 22 July 2025
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 14 (15) , 2919
Abstract
We present a lightweight autonomous driving method that uses a low-cost camera, a simple end-to-end convolutional neural network architecture, and smoother driving techniques to achieve energy-efficient vehicle control. Instead of directly constructing a mapping from raw sensory input to the action, our network takes the frame-to-frame visual difference as one of the crucial inputs to produce control commands, including the steering angle and the speed value at each time step. This choice of input allows highlighting the most relevant parts on raw image pairs to decrease the unnecessary visual complexity caused by different road and weather conditions. Additionally, our network achieves the prediction of the vehicle’s upcoming control commands by incorporating a view synthesis component into the model. The view synthesis, as an auxiliary task, aims to infer a novel view for the future from the historical environment transformation cue. By combining both the current and upcoming control commands, our framework achieves driving smoothness, which is highly associated with energy efficiency. We perform experiments on benchmarks to evaluate the reliability under different driving conditions in terms of control accuracy. We deploy a mobile robot outdoors to evaluate the power consumption of different control policies. The quantitative results demonstrate that our method can achieve energy efficiency in the real world.Keywords
Funding Information
- Natural Science Foundation of Zhejiang Province (LQ23F020023)
This publication has 41 references indexed in Scilit:
- Multifeature Selective Fusion Network for Real-Time Driving Scene ParsingIEEE Transactions on Instrumentation and Measurement, 2021
- Monocular depth estimation with SPN lossImage and Vision Computing, 2020
- SAANet: Spatial adaptive alignment network for object detection in automatic drivingImage and Vision Computing, 2020
- Learning Robust Control Policies for End-to-End Autonomous Driving From Data-Driven SimulationIEEE Robotics and Automation Letters, 2020
- Autonomous Obstacle Avoidance Vehicle Using LIDAR and an Embedded System2019
- 3D visual perception for self-driving cars using a multi-camera system: Calibration, mapping, localization, and obstacle detectionImage and Vision Computing, 2017
- An Open Approach to Autonomous VehiclesIEEE Micro, 2015
- Exploring Representation Learning With CNNs for Frame-to-Frame Ego-Motion EstimationIEEE Robotics and Automation Letters, 2015
- A Learning-Based Framework for Velocity Control in Autonomous DrivingIEEE Transactions on Automation Science and Engineering, 2015
- Retinomorphic Event-Based Vision Sensors: Bioinspired Cameras With Spiking OutputProceedings of the IEEE, 2014