Detecting, isolating, and enforcing dependencies among and within test cases
Author:
Open Access
- 11 November 2014
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 799-802
Abstract
Testing stateful applications is challenging, as it can be difficult to identify hidden dependencies on program state. These dependencies may manifest between several test cases, or simply within a single test case. When it's left to developers to document, understand, and respond to these dependencies, a mistake can result in unexpected and invalid test results. Although current testing infrastructure does not currently leverage state dependency information, we argue that it could, and that by doing so testing can be improved. Our results thus far show that by recovering dependencies between test cases and modifying the popular testing framework, JUnit, to utilize this information, we can optimize the testing process, reducing time needed to run tests by 62% on average. Our ongoing work is to apply similar analyses to improve existing state of the art test suite prioritization techniques and state of the art test case generation techniques.Keywords
Funding Information
- Division of Computer and Network Systems (CCF-1302269, CCF-1161079, CNS-0905246)
- Division of Computing and Communication Foundations (CCF-1302269, CCF-1161079, CNS-0905246)
- National Institutes of Health (U54 CA121852)
This publication has 17 references indexed in Scilit:
- Phosphor2014
- Empirically revisiting the test independence assumption2014
- Unit test virtualization with VMVM2014
- A large-scale, longitudinal study of user profiles in world of warcraft2013
- Regression testing minimization, selection and prioritization: a surveySoftware Testing, Verification and Reliability, 2012
- Feedback-Directed Random Test Generation29th International Conference on Software Engineering (ICSE'07), 2007
- Evolutionary testing of classes2004
- JCrasher: an automatic robustness tester for JavaSoftware: Practice and Experience, 2004
- Analyzing regression test selection techniquesIEEE Transactions on Software Engineering, 1996
- Performing data flow testing on classes1994