Vision-Cloud Data Fusion for ADAS: A Lane Change Prediction Case Study
- 10 August 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Vehicles
- Vol. 7 (2) , 210-220
Abstract
With the rapid development of intelligent vehicles and some successes in Advanced Driving Assistance Systems (ADAS), a new trend is that mixed levels of human driver engagements will be involved in the transportation system. Therefore, necessary visual guidance for drivers is vitally important under this situation to prevent potential risks. To advance the development of visual guidance systems, we introduce a novel vision-cloud data fusion methodology, integrating camera image and Digital Twin information from the cloud to help intelligent vehicles make better decisions. Target vehicle bounding box is drawn and matched by combining results of object detector running on ego vehicle and position information from the cloud. The best matching result, a 79.2% accuracy under 0.7 intersection over union threshold, is obtained with depth images served as an additional feature source. A case study on lane change prediction is conducted to show the effectiveness of the proposed data fusion methodology, where a multi-layer perceptron algorithm is proposed with modified approaches. Human-in-the-loop simulation results conducted in Unity game engine reveal that the proposed model can improve highway driving performance significantly in terms of safety, comfort, and environmental sustainability.Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- From simulation to experimentable digital twins: Simulation-based development and operation of complex technical systems2016
- Signal Processing for Smart Vehicle Technologies [From the Guest Editors]IEEE Signal Processing Magazine, 2016
- Industrial IoT lifecycle via digital twins2016
- Lane changing prediction at highway lane drops using support vector machine and artificial neural network classifiers2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Fast R-CNN2015
- A lane change detection approach using feature ranking with maximized predictive power2014
- Recent advances and trends in predictive manufacturing systems in big data environmentManufacturing Letters, 2013
- The Digital Twin Paradigm for Future NASA and U.S. Air Force Vehicles2012
- International Large-Scale Vehicle Corpora for Research on Driver Behavior on the RoadIEEE Transactions on Intelligent Transportation Systems, 2011