Towards a Test Automation Improvement Model (TAIM)
Authors:
- Sigrid EldhSESigrid Eldh
- Kenneth AnderssonKAKenneth Andersson
- Andreas ErmedahlAEAndreas Ermedahl
- Kristian WiklundKWKristian Wiklund
- 1 March 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 337-342
Abstract
In agile software development, industries are becoming more dependent on automated test suites. Thus, the test code quality is an important factor for the overall system quality and maintainability. We propose a Test Automation Improvement Model (TAIM) defining ten key areas and one general area. Each area should be based on measurements, to fill the gap of existing assessments models. The main contribution of this paper is to provide the outline of TAIM and present our intermediate results and some initial metrics to support our model. Our initial target has been the key area targeting implementation and structure of test code. We have used common static measurements to compare the test code and the source code of a unit test automation suite being part of a large complex telecom subsystem. Our intermediate results show that it is possible to outline such an improvement model and our metrics approach seems promising. However, to get a generic useful model to aid test automation evolution and provide for comparable measurements, many problems still remain to be solved. TAIM can as such be viewed as a framework to guide the research on metrics for test automation artifacts.Keywords
This publication has 19 references indexed in Scilit:
- Today/future importance analysis2010
- Software Metrics and Software Metrology2010
- Mining Software Repositories to Study Co-Evolution of Production & Test Code2008
- Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites2007
- TRex - The Refactoring and Metrics Tool for TTCN-3 Test Specifications2006
- Providing Test Quality Feedback Using Static Source Code and Automatic Test Suite Metrics2006
- Search‐based software test data generation: a surveySoftware Testing, Verification and Reliability, 2004
- Model-based testing for realInternational Journal on Software Tools for Technology Transfer, 2004
- Goal Question Metric ( GQM ) Approach2002
- Testing large software with automated software evaluation systemsACM SIGPLAN Notices, 1975