Differential Testing of Concurrent Classes
Authors:
- 31 March 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 255-266
Abstract
Concurrent programs are pervasive, yet difficult to write. The inherent complexity of thread synchronization makes the evolution of concurrent programs prone to concurrency faults. Previous work on regression testing concurrent programs focused on reducing the cost of re-run the existing tests. However, existing tests may not be able to expose the regression faults in the modified program. In this paper, we present Condiff a differential testing technique that generates concurrent tests and oracles to expose behavioral differences between two versions of a given concurrent class. Since concurrent programs are non-deterministic, this involves exploring all possible non-deterministic thread interleavings of each generated test on both versions. However, we can afford to analyze only a few concurrent tests due to the high cost of exhaustive interleaving exploration. To address the challenge, Condiff leverages the information of code changes and trace analysis to analyze only those concurrent tests that are likely to expose behavioral differences (if they exist). We evaluated Condiff on a set of Java classes. Our results show that Condiff can effectively generate concurrent tests that expose behavioral differences.Keywords
This publication has 76 references indexed in Scilit:
- Statically driven generation of concurrent tests for thread‐safe classesSoftware Testing, Verification and Reliability, 2021
- Regression Verification Using Impact Summaries2013
- Regression testing minimization, selection and prioritization: a surveySoftware Testing, Verification and Reliability, 2012
- Regression Verification for Multi-threaded Programs2012
- DiffGen: Automated Regression Unit-Test Generation2008
- Test-Suite Augmentation for Evolving Software2008
- Rostra: a framework for detecting redundant object-oriented unit tests2004
- Model checking JAVA programs using JAVA PathFinderInternational Journal on Software Tools for Technology Transfer, 2000
- Analyzing regression test selection techniquesIEEE Transactions on Software Engineering, 1996
- The temporal semantics of concurrent programsTheoretical Computer Science, 1981