Spatial Semantic Fuzzing for LiDAR-Based Autonomous Driving Perception Systems
- 31 October 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Software Engineering
- Vol. 52 (1) , 187-205
Abstract
Autonomous driving systems (ADSs) have the potential to enhance safety through advanced perception and reaction capabilities, reduce emissions by alleviating congestion, and contribute to various improvements in quality of life. Despite significant advancements in ADSs, several real-world accidents resulting in fatalities have occurred due to failures in the autonomous driving perception modules. As a critical component of autonomous vehicles, LiDAR-based perception systems are marked by high complexity and low interpretability, necessitating the development of effective testing methods for these systems. Current testing methods largely depend on manual data collection and labeling, which restricts their ability to detect a diverse range of erroneous behaviors. This process is not only time-consuming and labor-intensive, but it may also result in the recurrent discovery of similar erroneous behaviors during testing, hindering a comprehensive assessment of the systems. In this paper, we propose and implement a fuzzing framework for LiDAR-based autonomous driving perception systems, named LDFuzz, grounded in metamorphic testing theory. This framework offers the first uniform solution for the automated generation of tests with oracle information. To enhance testing efficiency and increase the number of tests that identify erroneous behaviors, we incorporate spatial and semantic coverage based on the characteristics of point cloud data to guide the generation process. We evaluate the performance of LDFuzz through experiments conducted on four LiDAR-based autonomous driving perception systems designed for the 3D object detection task. The experimental results demonstrate that the tests produced by LDFuzz can effectively detect an average of 7.5% more erroneous behaviors within LiDAR-based perception systems than the optimal baseline. Furthermore, the findings indicate that LDFuzz significantly enhances the diversity of failed tests.Keywords
Funding Information
- National Key Research and Development Program of China (2024YFF0908001)
- Shenzhen-Hong Kong-Macau Technology Research Programme (SGDX20230821091559018)
This publication has 50 references indexed in Scilit:
- Semantic-guided fuzzing for virtual testing of autonomous driving systemsJournal of Systems and Software, 2024
- MetaLiDAR: Automated metamorphic testing of LiDAR‐based autonomous driving systemsJournal of Software: Evolution and Process, 2023
- Autonomous driving system: A comprehensive surveyExpert Systems with Applications, 2023
- Evaluating seed selection for fuzzing JavaScript enginesEmpirical Software Engineering, 2023
- Model vs system level testing of autonomous driving systems: a replication and extension studyEmpirical Software Engineering, 2023
- 3D Object Detection for Autonomous Driving: A Comprehensive SurveyInternational Journal of Computer Vision, 2023
- Learning to Generate Realistic LiDAR Point Clouds2022
- Efficient Outdoor 3D Point Cloud Semantic Segmentation for Critical Road Objects and Distributed Contexts2020
- Perception, information processing and modeling: Critical stages for autonomous driving applicationsAnnual Reviews in Control, 2017
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009