Test processes in software product evolution—a qualitative survey on the state of practice
- 30 January 2003
- journal article
- research article
- Published by Wiley in Journal of Software Maintenance and Evolution: Research and Practice
- Vol. 15 (1) , 41-59
Abstract
In order to understand the state of test process practices in the software industry, we have conducted a qualitative survey, covering software development departments at 11 companies in Sweden of different sizes and application domains. The companies develop products in an evolutionary manner, which means either new versions are released regularly, or new product variants under new names are released. The survey was conducted through workshop and interview sessions, loosely guided by a questionnaire scheme.The main conclusions of the survey are that the documented development process is emphasized by larger organizations as a key asset, while smaller organizations tend to lean more on experienced people. Further, product volution is performed primarily as new product variants for embedded systems, and as new versions for packaged software. The development is structured using incremental development or a daily build approach; increments are used among more process‐focused organizations, and daily build is more frequently utilized in less process‐focused organizations. Test automation is performed using scripts for products with focus on functionality, and recorded data for products with focus on non‐functional properties. Test automation is an issue which most organizations want to improve; handling the legacy parts of the product and related documentation presents a common problem in improvement efforts for product evolution. Copyright © 2003 John Wiley & Sons, Ltd.Keywords
This publication has 9 references indexed in Scilit:
- Basics of Software Engineering Experimentation2001
- A survey of lead-time challenges in the development and evolution of distributed real-time systemsInformation and Software Technology, 2000
- Process diversity in software developmentIEEE Software, 2000
- Experimentation in Software Engineering2000
- Embracing change with extreme programmingComputer, 1999
- An experiment to assess the cost-benefits of code inspections in large scale software developmentIEEE Transactions on Software Engineering, 1997
- The combinatorial design approach to automatic test generationIEEE Software, 1996
- Comparing the Effectiveness of Software Testing StrategiesIEEE Transactions on Software Engineering, 1987
- The Mythical Man-Month1975