Clustering and Prioritization of Web Crowdsourced Test Reports Based on Text Classification
Open Access
- 1 January 2024
- journal article
- research article
- Published by IGI Global Scientific Publishing in International Journal of Web Services Research
- Vol. 21 (1) , 1-19
Abstract
In crowdsourced testing, prioritizing numerous test reports is critical for improving developer review efficiency. Many researchers have proposed methods for prioritizing crowdsourced test reports for mobile applications, however, web crowdsourced test reports usually contain more detailed text and more complex screenshots, which makes prioritizing them especially necessary. This paper proposes a prioritization method named TCDiv, based on the data characteristics of web crowdsourcing test reports. First, using a pre-trained TextCNN model, the text of each report is segmented into two parts: reproduction steps and defect descriptions. Then, features are extracted from textual and image information respectively, and clustering technique is utilized to classify similar reports, and finally the clustering results are ranked and sampled. To validate the approach, experiments were conducted on 717 web crowdsourced test reports. The results show that TCDiv can detect more different defects in a limited time, thus improving the review efficiency of the development team.Keywords
This publication has 32 references indexed in Scilit:
- Mobile crowdsourced test report prioritization based on text and image understandingJournal of Software: Evolution and Process, 2023
- Classifying crowdsourced mobile test reports with image features: An empirical studyJournal of Systems and Software, 2022
- Crowdsourced test report prioritization considering bug severityInformation and Software Technology, 2021
- Crowdsourced software testing: A systematic literature reviewInformation and Software Technology, 2020
- Improving text classification with weighted word embeddings via a multi-channel TextCNN modelNeurocomputing, 2019
- Clustering Study of Crowdsourced Test Report with Multi-source Heterogeneous Information2019
- Images don’t lie: Duplicate crowdtesting reports detection with screenshot informationInformation and Software Technology, 2019
- A New LSTM Network Model Combining TextCNN2018
- A survey of the use of crowdsourcing in software engineeringJournal of Systems and Software, 2017
- Individual Comparisons by Ranking Methods1992