Online scheduling for a Testing-as-a-Service system
Authors:
Open Access
- 31 August 2020
- journal article
- research article
- Published by Polish Academy of Sciences Chancellery in Bulletin Of The Polish Academy Of Sciences-Technical Sciences
- Vol. 68 (4) , 869-882
Abstract
The problem of performing software tests using Testing-as-a-Service cloud environment is considered and formulated as an~online cluster scheduling on parallel machines with total flowtime criterion. A mathematical model is proposed. Several properties of the problem, including solution feasibility and connection to the classic scheduling on parallel machines are discussed. A family of algorithms based on a new priority rule called the Smallest Remaining Load (SRL) is proposed. We prove that algorithms from that family are not competitive relative to each other. Computer experiment using real-life data indicated that the SRL algorithm using the longest job sub-strategy is the best in performance. This algorithm is then compared with the Simulated Annealing metaheuristic. Results indicate that the metaheuristic rarely outperforms the SRL algorithm, obtaining worse results most of the time, which is counter-intuitive for a metaheuristic. Finally, we test the accuracy of prediction of processing times of jobs. The results indicate high (91.4%) accuracy for predicting processing times of test cases and even higher (98.7%) for prediction of remaining load of test suites. Results also show that schedules obtained through prediction are stable (coefficient of variation is 0.2‒3.7%) and do not affect most of the algorithms (around 1% difference in flowtime), proving the considered problem is semi-clairvoyant. For the Largest Remaining Load rule, the predicted values tend to perform better than the actual values. The use of predicted values affects the SRL algorithm the most (up to 15% flowtime increase), but it still outperforms other algorithms.Keywords
This publication has 11 references indexed in Scilit:
- Automated parallel GUI testing as a service for mobile applicationsJournal of Software: Evolution and Process, 2018
- Tight lower bounds for semi-online scheduling on two uniform machines with known optimumCentral European Journal of Operations Research, 2018
- Financial optimisation of the scheduling for the multi-stage projectBulletin Of The Polish Academy Of Sciences-Technical Sciences, 2017
- Stable scheduling of single machine with probabilistic parametersBulletin Of The Polish Academy Of Sciences-Technical Sciences, 2017
- Composing and Delivering Heterogeneous Web Testing Software as a Composite Web Testing Service2016
- Job-aware Scheduling in Eagle2016
- The Impacts of Test Automation on Software's Cost, Quality and Time to MarketProcedia Computer Science, 2016
- A review of metaheuristic scheduling techniques in cloud computingEgyptian Informatics Journal, 2015
- Makespan minimization in online scheduling with machine eligibilityAnnals of Operations Research, 2013
- Approximating total flow time on parallel machinesJournal of Computer and System Sciences, 2007