Combining Text Mining and Data Mining for Bug Report Classification
Authors:
- Yu ZhouYZYu Zhou
- Yanxiang TongYTYanxiang Tong
- Ruihang GuRGRuihang Gu
- Harald GallHGHarald Gall
- 1 September 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636773,p. 311-320
Abstract
Misclassification of bug reports inevitably sacrifices the performance of bug prediction models. Manual examinations can help reduce the noise but bring a heavy burden for developers instead. In this paper, we propose a hybrid approach by combining both text mining and data mining techniques of bug report data to automate the prediction process. The first stage leverages text mining techniques to analyze the summary parts of bug reports and classifies them into three levels of probability. The extracted features and some other structured features of bug reports are then fed into the machine learner in the second stage. Data grafting techniques are employed to bridge the two stages. Comparative experiments with previous studies on the same data -- three large-scale open source projects -- consistently achieve a reasonable enhancement (from 77.4% to 81.7%, 73.9% to 80.2% and 87.4% to 93.7%, respectively) over their best results in terms of overall performance. Additional comparative empirical experiments on other two popular open source repositories confirm the findings and demonstrate the benefits of our approach.Keywords
This publication has 39 references indexed in Scilit:
- Classifying Bug Reports to Bugs and Other Requests Using Topic Modeling2013
- Tag recommendation in software information sites2013
- Automatic classification of software related microblogs2012
- Reducing Features to Improve Code Change-Based Bug PredictionIEEE Transactions on Software Engineering, 2012
- Validity concerns in software engineering research2010
- A discriminative model approach for accurate duplicate bug report retrieval2010
- On predicting the time taken to correct bug reports in open source projects2009
- Guidelines for conducting and reporting case study research in software engineeringEmpirical Software Engineering, 2008
- Detection of Duplicate Defect Reports Using Natural Language Processing29th International Conference on Software Engineering (ICSE'07), 2007
- Who should fix this bug?2006