Badge: Prioritizing UI Events with Hierarchical Multi-Armed Bandits for Automated UI Testing
Authors:
- 1 May 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 894-905
Abstract
To assure high quality of mobile applications (apps for short), automated UI testing triggers events (associated with UI elements on app UIs) without human intervention, aiming to maximize code coverage and find unique crashes. To achieve high test effectiveness, automated UI testing prioritizes a UI event based on its exploration value (e.g., the increased code coverage of future exploration rooted from the UI event). Various strategies have been proposed to estimate the exploration value of a UI event without considering its exploration diversity (reflecting the variance of covered code entities achieved by explorations rooted from this UI event across its different triggerings), resulting in low test effectiveness, especially on complex mobile apps. To address the preceding problem, in this paper, we propose a new approach named Badge to prioritize UI events considering both their exploration values and exploration diversity for effective automated UI testing. In particular, we design a hierarchical multi-armed bandit model to effectively estimate the exploration value and exploration diversity of a UI event based on its historical explorations along with historical explorations rooted from UI events in the same UI group. We evaluate Badge on 21 highly popular industrial apps widely used by previous related work. Experimental results show that Badge outperforms state-of-the-art/practice tools with 18%-146% relative code coverage improvement and finding 1.19-5.20 × unique crashes, demonstrating the effectiveness of Badge. Further experimental studies confirm the benefits brought by Badge's individual algorithms.Keywords
Funding Information
- National Natural Science Foundation of China (62161146003)
This publication has 33 references indexed in Scilit:
- Humanoid: A Deep Learning-Based Approach to Automated Black-box Android App Testing2019
- Risk-aware multi-armed bandit problem with application to portfolio selectionRoyal Society Open Science, 2017
- Large-Scale Bandit Approaches for Recommender Systems2017
- Mastering the game of Go with deep neural networks and tree searchNature, 2016
- Automated Test Input Generation for Android: Are We There Yet? (E)2015
- Contextual Bandits for Context-Based Information Retrieval2013
- Multi-armed Bandit Algorithms and Empirical Evaluation2005
- Finite-time Analysis of the Multiarmed Bandit ProblemMachine Learning, 2002
- The Probabilistic Basis of Jaccard's Index of SimilaritySystematic Biology, 1996
- ON THE LIKELIHOOD THAT ONE UNKNOWN PROBABILITY EXCEEDS ANOTHER IN VIEW OF THE EVIDENCE OF TWO SAMPLESBiometrika, 1933