Levels of Exploration in Exploratory Testing: From Freestyle to Fully Scripted
Open Access
- 10 May 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 6, 26416-26423
Abstract
Exploratory testing (ET) is a powerful and efficient way of testing software by integrating design, execution, and analysis of tests during a testing session. ET is often contrasted with scripted testing, and seen as a choice of either exploratory testing or not. In contrast, we pose that exploratory testing can be of varying degrees of exploration from fully exploratory to fully scripted. In line with this, we propose a scale for the degree of exploration and define five levels. In our classification, these levels of exploration correspond to the way test charters are defined. We have evaluated this classification through focus groups at four companies and identified factors that influence the choice of exploration level. The results show that the proposed levels of exploration are influenced by different factors such as ease to reproduce defects, better learning, verification of requirements, etc., and that the levels can be used as a guide to structure test charters. Our study also indicates that applying a combination of exploration levels can be beneficial in achieving effective testing.Keywords
Funding Information
- EASE Industrial Excellence Center for Embedded Applications Software Engineering
This publication has 10 references indexed in Scilit:
- Checklists to Support Test Charter Design in Exploratory Testing2017
- SERP-test: a taxonomy for supporting industry–academia communicationSoftware Quality Journal, 2016
- Maintenance of automated test suites in industry: An empirical study on Visual GUI TestingInformation and Software Technology, 2016
- Do Exploratory Testers Need Formal Training? An Investigation Using HCI Techniques2016
- Test Better by Exploring: Harnessing Human Skills and KnowledgeIEEE Software, 2015
- Exploratory software testing in agile project2015
- How is exploratory testing used? A state-of-the-practice survey2014
- An experiment on the effectiveness and efficiency of exploratory testingEmpirical Software Engineering, 2014
- Towards a hybrid testing process unifying exploratory testing and scripted testingJournal of Software: Evolution and Process, 2013
- The Role of the Tester's Knowledge in Exploratory Software TestingIEEE Transactions on Software Engineering, 2012