The Next Level of Test Automation: What About the Users?
Authors:
- Kristian WiklundKWKristian Wiklund
- Monika WiklundMWMonika Wiklund
- 1 April 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 159-162
Abstract
Test automation is an enabler for effective and efficient software development and is widely embraced thanks to agile practices such as continuous integration. Based on our own experience and observations, we conjecture that the majority of test automation today is script based and focused on execution, where testers explicitly implement "how" to do the test. This is a labor-intensive and potentially error-prone endeavor that have the potential to be a significant bottleneck for even productivity and speed in software development. Hence, we consider it clear that "the next level of test automation" to a greater extent will be about "what" to test and not "how" to test it, which will require more advanced test tools and test systems compared to today's relatively simple mechanisms. We propose that this will result in an increased dependency to tools developed outside the user organizations, partially due to the cost and complexity of development of advanced tools, and partially due to the competence needed to understand and implement the necessary algorithms which simply will not be available in most development projects. In this paper, we draw on our experience from using and developing test automation tools to propose a number of challenges that we believe need to be considered when introducing new approaches to test automation in industry.Keywords
This publication has 34 references indexed in Scilit:
- Topic-Driven Testing2017
- TESTARInternational Journal of Information System Modeling and Design, 2015
- Impediments for Automated Testing -- An Empirical Analysis of a User Support Discussion Board2014
- Automated Detection of Test Fixture Strategies and Smells2013
- Impediments in Agile Software Development: An Empirical InvestigationLecture Notes in Computer Science, 2013
- Testing in the Wild: The Social and Organisational Dimensions of Real World PracticeComputer Supported Cooperative Work (CSCW), 2009
- Empirical Observations on Software Testing Automation2009
- Violating Assumptions with FuzzingIEEE Security & Privacy, 2005
- A minimal test practice framework for emerging software organizationsSoftware Testing, Verification and Reliability, 2005
- Introducing Test Automation and Test-Driven Development: An Experience ReportElectronic Notes in Theoretical Computer Science, 2005