On the Analysis of Coverage Feedback in a Fuzzing Proprietary System
Open Access
- 8 July 2024
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 14 (13) , 5939
Abstract
Coverage feedback is one of the key mechanisms for improving the effectiveness of fuzzers by measuring and comparing the executed code regions while processing input data. In general, such guidance should always improve the performance of fuzzers to better find unexplored code regions. However, proprietary systems with uncommon I/O interfaces (e.g., UAV system, IoT devices, satellite firmware) require extensive engineering/porting efforts to apply coverage feedback support in developing their fuzzing platform. In this paper, we evaluate the detailed efficacy of coverage feedback in fuzzing based on 44 real-world bugs we found using OSS-Fuzz. Our analysis uncovered when and how code coverage information can be helpful, and our experiment demonstrates that although coverage guidance is always helpful to some extent, its effectiveness depends on various external factors. Therefore, such factors should be carefully considered for optimizing the cost and efficiency in designing the fuzzing architecture of proprietary systems.Keywords
Funding Information
- Convergence security core talent training business support program (IITP-2024-RS-2023-00266615, KRIT-CT-22-074, KHU-20230880)
- KRIT (Korea Research Institute for defense Technology planning and advancement) (IITP-2024-RS-2023-00266615, KRIT-CT-22-074, KHU-20230880)
- Defense Acquisition Program Administration (DAPA) (IITP-2024-RS-2023-00266615, KRIT-CT-22-074, KHU-20230880)
- Kyung Hee University (IITP-2024-RS-2023-00266615, KRIT-CT-22-074, KHU-20230880)
This publication has 22 references indexed in Scilit:
- Improving AFL++ CmpLog: Tackling the Bottlenecks2023
- Fuzzability Testing Framework for Incomplete Firmware BinaryIEEE Access, 2023
- JITfuzz: Coverage-guided Fuzzing for JVM Just-in-Time Compilers2023
- FIRM-COV: High-Coverage Greybox Fuzzing for IoT Firmware via Optimized Process EmulationIEEE Access, 2021
- AFLNET: A Greybox Fuzzer for Network Protocols2020
- Fw‐fuzz: A code coverage‐guided fuzzing framework for network protocols on firmwareConcurrency and Computation: Practice and Experience, 2020
- The Art, Science, and Engineering of Fuzzing: A SurveyIEEE Transactions on Software Engineering, 2019
- An Executable Formalisation of the SPARCv8 Instruction Set Architecture: A Case Study for the LEON3 Processor2016
- LAVA: Large-Scale Automated Vulnerability Addition2016
- An empirical study of the reliability of UNIX utilitiesCommunications of the ACM, 1990