DASE: Document-Assisted Symbolic Execution for Improving Automated Software Testing
Authors:
- Edmund WongEWEdmund Wong
- Lei ZhangLZLei Zhang
- Song WangSWSong Wang
- Taiyue LiuTLTaiyue Liu
- Lin TanLTLin Tan
- 1 May 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1 (02705257) , 620-631
Abstract
We propose and implement a new approach, Document-Assisted Symbolic Execution (DASE), to improve automated test generation and bug detection. DASE leverages natural language processing techniques and heuristics to analyze program documentation to extract input constraints automatically. DASE then uses the input constraints to guide symbolic execution to focus on inputs that are semantically more important.We evaluated DASE on 88 programs from 5 mature real-world software suites: COREUTILS, FINDUTILS, GREP, BINUTILS, and ELFTOOLCHAIN. DASE detected 12 previously unknown bugs that symbolic execution without input constraints failed to detect, 6 of which have already been confirmed by the developers. In addition, DASE increases line coverage, branch coverage, and call coverage by 14.2 -- 120.3%, 2.3 -- 167.7%, and 16.9 -- 135.2% respectively, which are 6.0 -- 21.1 percentage points (pp), 1.6 -- 18.9 pp, and 2.8 -- 20.1 pp increases. The accuracies of input constraint extraction are 97.8 -- 100%.Keywords
This publication has 49 references indexed in Scilit:
- Comparison and integration of genetic algorithms and dynamic symbolic execution for security testing of cross-site scripting vulnerabilitiesInformation and Software Technology, 2013
- Symbolic PathFinder: integrating symbolic execution with model checking for Java bytecode analysisAutomated Software Engineering, 2013
- High-Coverage Symbolic Patch TestingLecture Notes in Computer Science, 2012
- Inferring specifications for resources from natural language API documentationAutomated Software Engineering, 2011
- A Specification-Based Test Case Generation Method for UML/OCL2011
- Pex–White Box Test Generation for .NET2008
- The Daikon system for dynamic detection of likely invariantsScience of Computer Programming, 2007
- KoratACM SIGSOFT Software Engineering Notes, 2002
- Generating Tests from UML Specifications1999
- Symbolic execution and program testingCommunications of the ACM, 1976