A Trusted Supervision Paradigm for Autonomous Driving Based on Multimodal Data Authentication
Open Access
- 2 September 2024
- journal article
- research article
- Published by MDPI AG in Big Data and Cognitive Computing
- Vol. 8 (9) , 100
Abstract
At the current stage of autonomous driving, monitoring the behavior of safety stewards (drivers) is crucial to establishing liability in the event of an accident. However, there is currently no method for the quantitative assessment of safety steward behavior that is trusted by multiple stakeholders. In recent years, deep-learning-based methods can automatically detect abnormal behaviors with surveillance video, and blockchain as a decentralized and tamper-resistant distributed ledger technology is very suitable as a tool for providing evidence when determining liability. In this paper, a trusted supervision paradigm for autonomous driving (TSPAD) based on multimodal data authentication is proposed. Specifically, this paradigm consists of a deep learning model for driving abnormal behavior detection based on key frames adaptive selection and a blockchain system for multimodal data on-chaining and certificate storage. First, the deep-learning-based detection model enables the quantification of abnormal driving behavior and the selection of key frames. Second, the key frame selection and image compression coding balance the trade-off between the amount of information and efficiency in multiparty data sharing. Third, the blockchain-based data encryption sharing strategy ensures supervision and mutual trust among the regulatory authority, the logistic platform, and the enterprise in the driving process.Keywords
Funding Information
- Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing (GJJ-24-002, 2024-YC-A127)
- BUPT innovation and entrepreneurship support program (GJJ-24-002, 2024-YC-A127)
This publication has 37 references indexed in Scilit:
- Multisource traffic incident reporting and evidence management in Internet of Vehicles using machine learning and blockchainEngineering Applications of Artificial Intelligence, 2022
- Smart contract based digital evidence management framework over blockchain for vehicle accident investigation in IoV eraJournal of King Saud University Computer and Information Sciences, 2022
- Unsupervised video anomaly detection via normalizing flows with implicit latent featuresPattern Recognition, 2022
- Blockchain-based framework for supply chain traceability: A case example of textile and clothing industryComputers & Industrial Engineering, 2021
- Residual spatiotemporal autoencoder for unsupervised video anomaly detectionSignal, Image and Video Processing, 2020
- Block-DEF: A secure digital evidence framework using blockchainInformation Sciences, 2019
- Autonomous driving in urban environments: approaches, lessons and challengesPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2010
- The H.264/MPEG4 advanced video coding standard and its applicationsIEEE Communications Magazine, 2006
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- MPEG2 video codec using image compression DSPIEEE Transactions on Consumer Electronics, 1994