Test Suite Optimization Using Machine Learning Techniques: A Comprehensive Study
Open Access
- 1 November 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 168645-168671
Abstract
Software testing is an essential yet costly phase of the software development lifecycle. While machine learning-based test suite optimization techniques have shown promise in reducing testing costs and improving fault detection, a comprehensive evaluation of their effectiveness across different environments is still lacking. This paper reviews 43 studies published between 2018 and 2023, covering various test case selection, prioritization, and reduction techniques using machine learning. The findings reveal that conventional machine learning techniques, particularly supervised learning methods, have been widely adopted for test case prioritization and selection. Recent advancements, such as deep learning and hybrid models, show potential in improving fault detection rates and scalability, though challenges remain in adapting these techniques to large-scale and dynamic environments. Additionally, Generative AI and large language models (LLMs) are emerging as promising tools for automating aspects of test case generation and prioritization, offering new avenues for future research in enhancing test suite optimization. The study identifies recent trends, challenges, and opportunities for further research, with a focus on both conventional and emerging methods, including deep learning, hybrid approaches, and Generative AI models. By systematically analyzing these techniques, this work contributes to the understanding of how machine learning and Generative AI can enhance test suite optimization and highlights future directions for improving the scalability and real-world applicability of these methods.Keywords
Funding Information
- Dakota State University, USA
This publication has 57 references indexed in Scilit:
- TEP-GNN: Accurate Execution Time Prediction of Functional Tests Using Graph Neural Networks2022
- Improving the prediction of continuous integration build failures using deep learningAutomated Software Engineering, 2022
- Test case selection and prioritization using machine learning: a systematic literature reviewEmpirical Software Engineering, 2021
- Transfer Learning for Automated Test Case Prioritization Using XCSF2021
- Automating system test case classification and prioritization for use case-driven testing in product linesEmpirical Software Engineering, 2020
- LSTM-based deep learning for spatial–temporal software testingDistributed and Parallel Databases, 2020
- RETRACTED ARTICLE: Soft computing-based semi-automated test case selection using gradient-based techniquesSoft Computing, 2020
- Neural Network Based Test Case Prioritization in Software Engineering2018
- A hybrid-adaptive neuro-fuzzy inference system for multi-objective regression test suites optimizationNeural Computing and Applications, 2018
- Clustering and Combinatorial Methods for Test Suite Prioritization of GUI and Web Applications2018