On the Vocabulary Agreement in Software Issue Descriptions
Authors:
- Oscar ChaparroOCOscar Chaparro
- Juan Manuel FlorezJFJuan Manuel Florez
- Andrian MarcusAMAndrian Marcus
- 1 October 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 448-452
Abstract
Many software comprehension tasks depend on how stakeholders textually describe their problems. These textual descriptions are leveraged by Text Retrieval (TR)-based solutions to more than 20 software engineering tasks, such as duplicate issue detection. The common assumption of such methods is that text describing the same issue in multiple places will have a common vocabulary. This paper presents an empirical study aimed at verifying this assumption and discusses the impact of the common vocabulary on duplicate issue detection. The study investigated 13K+ pairs of duplicate bug reports and Stack Overflow (SO) questions. We found that on average, more than 12.2% of the duplicate pairs do not have common terms. The other duplicate issue descriptions share, on average, 30% of their vocabulary. The good news is that these duplicates have significantly more terms in common than the non-duplicates. We also found that the difference between the lexical agreement of duplicate and non-duplicate pairs is a good predictor for the performance of TR-based duplicate detection.Keywords
This publication has 14 references indexed in Scilit:
- StORMeD: Stack Overflow Ready Made Data2015
- On the Relationship between the Vocabulary of Bug Reports and Source Code2013
- Finding Duplicates of Your Yet Unwritten Bug Report2013
- On the Use of Domain Terms in Source Code2008
- Asking and Answering Questions during a Programming Change TaskIEEE Transactions on Software Engineering, 2008
- Detection of Duplicate Defect Reports Using Natural Language Processing29th International Conference on Software Engineering (ICSE'07), 2007
- Coping with an open bug repository2005
- Human Variation and Lexical ChoiceComputational Linguistics, 2002
- Knowing versus Naming: Similarity and the Linguistic Categorization of ArtifactsJournal of Memory and Language, 1999
- The vocabulary problem in human-system communicationCommunications of the ACM, 1987