An Empirical Assessment of the Performance of Multi-Armed Bandits and Contextual Multi-Armed Bandits in Handling Cold-Start Bugs
Open Access
- 3 August 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 750-758
Abstract
Bug triaging is a crucial activity in software development that involves identifying and prioritizing bugs for fixing. But recommending cold bugs to an appropriate developer is a more challenging problem. In this work, an empirical assessment of the effectiveness of two reinforcement learning algorithms, Multiarmed bandits and Contextual bandits, in the context of triaging cold-start bugs, is investigated. Five publicly available open-source bug-triaging datasets have been used to evaluate the performance of the algorithms using two standard evaluation metrics i.e., rewards and average rewards. Evaluations are done of two MAB algorithms- ɛ-Greedy and UCB, and LinUCB as a Contextual MAB algorithm. Our results showed that both Multiarmed bandits and Contextual bandits are effective in triaging cold start bugs but in different settings. Contextual bandits outperformed Multiarmed bandits in terms of rewards and average reward in different simulation settings. Our results demonstrate that contextual MAB algorithms outperform traditional MAB algorithms in accurately recommending cold bugs to an appropriate developer.Keywords
This publication has 8 references indexed in Scilit:
- Automatic Bug Triaging via Deep Reinforcement LearningApplied Sciences, 2022
- MABTriage: Multi Armed Bandit Triaging Model Approach2021
- Mostly Exploration-Free Algorithms for Contextual BanditsManagement Science, 2021
- Ranking of software developers based on expertise score for bug triagingInformation and Software Technology, 2019
- A Multi-Armed Bandit Model Selection for Cold-Start User Recommendation2017
- An Introduction to Reinforcement Learning2012
- A contextual-bandit approach to personalized news article recommendation2010
- Reinforcement Learning: A Tutorial Survey and Recent AdvancesINFORMS Journal on Computing, 2009