Killing strategies for model‐based mutation testing
- 3 February 2014
- journal article
- research article
- Published by Wiley in Software Testing, Verification and Reliability
- Vol. 25 (8) , 716-748
Abstract
Summary: This article presents the techniques and results of a novel model‐based test case generation approach that automatically derives test cases from UML state machines. The main contribution of this article is the fully automated fault‐based test case generation technique together with two empirical case studies derived from industrial use cases. Also, an in‐depth evaluation of different fault‐based test case generation strategies on each of the case studies is given and a comparison with plain random testing is conducted. The test case generation methodology supports a wide range of UML constructs and is grounded on the formal semantics of Back's action systems and the well‐known input–output conformance relation. Mutation operators are employed on the level of the specification to insert faults and generate test cases that will reveal the faults inserted. The effectiveness of this approach is shown and it is discussed how to gain a more expressive test suite by combining cheap but undirected random test case generation with the more expensive but directed mutation‐based technique. Finally, an extensive and critical discussion of the lessons learnt is given as well as a future outlook on the general usefulness and practicability of mutation‐based test case generation. Copyright © 2014 John Wiley & Sons, Ltd.Keywords
This publication has 32 references indexed in Scilit:
- Incremental Refinement Checking for Test Case GenerationLecture Notes in Computer Science, 2013
- UML in actionACM SIGSOFT Software Engineering Notes, 2011
- Model Based Testing with Labelled Transition Systems2008
- Assessing and improving state-based class testing: a series of experimentsIEEE Transactions on Software Engineering, 2004
- MuJava: an automated class mutation systemSoftware Testing, Verification and Reliability, 2004
- TGV: theory, principles and algorithmsInternational Journal on Software Tools for Technology Transfer, 2004
- Investigations of the software testing coupling effectACM Transactions on Software Engineering and Methodology, 1992
- Software testing based on formal specifications: a theory and a toolSoftware Engineering Journal, 1991
- Decentralization of process nets with centralized controlDistributed Computing, 1989
- Program testing by specification mutationComputer Languages, 1985