A CCT-Centered Framework for Testing-Based Formal Verification: Bounded Exploration, Parallel Test Generation, and Fault Localization
Preprint
- 29 July 2026
- preprint
- Published by Elsevier in SSRN Electronic Journal
Abstract
Testing-based formal verification (TBFV) combines concrete execution with formal checking of represented program paths. Condition Sequence Coverage (CSC) and the Condition Case Tree (CCT) make this exploration systematic while controlling loop-induced growth. We present a CCT-centered framework that extends CSC-based TBFV in three ways. CSC+Boundary reconsiders ancestor-stopped obligations under a selected finite input constraint and classifies them as concrete, infeasible over the specification input domain, or range-excluded. Parallel CCT-frontier generation executes snapshot-visible candidates concurrently and merges their traces deterministically. Fold-the-Tree fault localization folds refined-TBFV outcomes, CCT topology, and assignment/return trace events into ranked condition and state-update candidates. We implement the framework in Java and evaluate it on 42 subjects and 252 retained mutants, 225 of which provide failure evidence for diagnosis. Bounded exploration leaves loop-free subjects unchanged and resolves all observed ancestor-stopped obligations in loop-bearing subjects. Across 210 loop-bearing mutants, CSC+Boundary increases the kill rate from 77.6% to 92.4%. With eight workers, parallel generation achieves mean and median speedups of 1.80× and 1.89×, while all canonical output fingerprints match across worker settings and repetitions. Under a matched source-line budget, the CCT-based composite has higher observed Top-1 and Top-2 hit rates than the strongest evaluated spectrum-based fault localization (SBFL) baseline and ties it at Top-3; after Holm correction, none of the paired differences is significant at the 0.05 level.Keywords
This publication has 15 references indexed in Scilit:
- Condition Sequence Coverage Criterion and Automatic Test Case Generation for Testing-Based Formal Verification2025
- Specification-based Test Case Generation for C++ Engineering Software2023
- Enhancing the Capability of Testing-Based Formal Verification by Handling Operations in Software PackagesIEEE Transactions on Software Engineering, 2022
- Automatic Test Case and Test Oracle Generation Based on Functional Scenarios in Formal Specifications for Conformance TestingIEEE Transactions on Software Engineering, 2020
- Mutation Testing Advances: An Analysis and Survey2019
- A Survey on Software Fault LocalizationIEEE Transactions on Software Engineering, 2016
- The DStar Method for Effective Software Fault LocalizationIEEE Transactions on Reliability, 2013
- An Approach to Detecting Domain Errors Using Formal Specification-Based Testing2005
- What is software testing? And why is it so hard?IEEE Software, 2000
- Note on the Sampling Error of the Difference Between Correlated Proportions or PercentagesPsychometrika, 1947