Protocol vulnerability detection based on network traffic analysis and binary reverse engineering
Open Access
- 19 October 2017
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 12 (10) , e0186188
Abstract
Network protocol vulnerability detection plays an important role in many domains, including protocol security analysis, application security, and network intrusion detection. In this study, by analyzing the general fuzzing method of network protocols, we propose a novel approach that combines network traffic analysis with the binary reverse engineering method. For network traffic analysis, the block-based protocol description language is introduced to construct test scripts, while the binary reverse engineering method employs the genetic algorithm with a fitness function designed to focus on code coverage. This combination leads to a substantial improvement in fuzz testing for network protocols. We build a prototype system and use it to test several real-world network protocol implementations. The experimental results show that the proposed approach detects vulnerabilities more efficiently and effectively than general fuzzing methods such as SPIKE.Keywords
This publication has 6 references indexed in Scilit:
- Statically-Directed Dynamic Taint AnalysisChinese Journal of Electronics, 2014
- Evaluation of the Capabilities of WireShark as a tool for Intrusion DetectionInternational Journal of Computer Applications, 2010
- A Case for Protocol Dependency2006
- ReVirtACM SIGOPS Operating Systems Review, 2002
- Software Security Assessment through Specification Mutations and Fault Injection2001
- Genetic Algorithms and Machine LearningMachine Learning, 1988