Automatic test case generation from Simulink/Stateflow models using model checking
- 22 January 2013
- journal article
- research article
- Published by Wiley in Software Testing, Verification and Reliability
- Vol. 24 (2) , 155-180
Abstract
SUMMARY: Model‐based test generation techniques based on random input generation and guided simulation do not satisfy the demands of high test coverage and completeness guarantees as required by safety‐critical applications. Recently, test generation techniques based on model checking have been reported to bridge this gap. To evaluate the effectiveness of these techniques, an in‐house tool suite, AutoMOTGen, has been developed for Simulink/Stateflow and applied on real‐life case studies at General Motors. This paper outlines the test generation methodology of AutoMOTGen and gives a comparative study with a commercial, primarily random input‐based, test generation tool on the same set of examples. The results indicate that in terms of coverage, model checking‐based techniques complement the random input‐based techniques. In addition, they provide proofs for unreachability that can aid in debugging the models. Therefore, it is recommended that model checking‐based tools be utilized to complement and enhance the effectiveness of model‐based testing methods in safety‐critical systems engineering. Copyright © 2013 John Wiley & Sons, Ltd.Keywords
This publication has 28 references indexed in Scilit:
- SimCheck: a contract type system for SimulinkInnovations in Systems and Software Engineering, 2011
- Conformance Testing of Hybrid Systems with Qualitative Reasoning ModelsElectronic Notes in Theoretical Computer Science, 2009
- Testing with model checkers: a surveySoftware Testing, Verification and Reliability, 2008
- Model-Based Testing of Object-Oriented Reactive Systems with Spec Explorer2008
- Translating discrete-time simulink to lustreACM Transactions on Embedded Computing Systems, 2005
- Specifying and Generating Test Cases Using Observer Automata2005
- Counterexample-guided abstraction refinement for symbolic model checkingJournal of the ACM, 2003
- Fault classes and error detection capability of specification-based testingACM Transactions on Software Engineering and Methodology, 1999
- Applicability of modified condition/decision coverage to software testingSoftware Engineering Journal, 1994
- The synchronous data flow programming language LUSTREProceedings of the IEEE, 1991