Exploration and Exploitation Mechanism in Pairwise Test Case Generation: A Systematic Literature Review
Open Access
- 2 May 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 82342-82377
Abstract
Software systems are essential in modern life, requiring rigorous testing to ensure reliability. Pairwise testing, a combinatorial testing methodology, optimizes test case generation by minimizing redundancy while maintaining defect detection effectiveness. This review systematically examines the role of metaheuristic algorithms in pairwise test case generation, focusing on their exploration and exploitation mechanisms to address local optima challenges. Covering research from 2014 to 2024, the review evaluates hybrid and metaheuristic strategies, including Pairwise Migrating Birds Optimization-Based Strategies (PMBOS), Pairwise Gravitational Search Algorithm Strategy (PGSAS), Pairwise hybrid Artificial Bee Colony (PhABC), Genetic and Particle Swarm Optimization (GAPSO) algorithm, Hybrid Optimization Algorithm (HOA), and Parameter Free Choice Function based Hyper-Heuristic (PCFHH), among others. These methods consistently outperform traditional techniques by reducing test suite sizes and enhancing fault detection capabilities. The findings underscore the growing adoption of the one-test-at-a-time (OTAT) approach over the one-parameter-at-a-time (OPAT) approach and identify key challenges in scalability, hyperparameter tuning, and constraint handling, highlighting the need for hybrid strategies and adaptive optimization techniques. This review offers valuable insights into advancing software testing methodologies and presents recommendations for future research to improve efficiency, scalability, and fault detection in pairwise testing.Keywords
Funding Information
- Ministry of Higher Education Malaysia through the Fundamental Research Grant Scheme (FRGS/1/2023/ICT01/UTP/02/2)
This publication has 157 references indexed in Scilit:
- An investigation of distributed computing for combinatorial testingSoftware Testing, Verification and Reliability, 2023
- Artificial gorilla troops optimizer: A new nature‐inspired metaheuristic algorithm for global optimization problemsInternational Journal of Intelligent Systems, 2021
- Seasons optimization algorithmEngineering with Computers, 2020
- Color harmony algorithm: an art-inspired metaheuristic for mathematical function optimizationSoft Computing, 2020
- Pairwise Test Suite Generation Based on Hybrid Artificial Bee Colony Algorithm2019
- Pairwise Test Suite Generation Using Adaptive Teaching Learning-Based Optimization Algorithm with Remedial Operator2018
- A History of Metaheuristics2018
- Evaluation of Tie-Breaking and Parameter Ordering for the IPO Family of Algorithms Used in Covering Array Generation2018
- Sequence Generation of Test Case Using Pairwise Approach Methodology2017
- Pairwise testing for systems with data derived from real-valued variable inputsSoftware: Practice and Experience, 2014