Automated Extraction and Clustering of Requirements Glossary Terms
Open Access
- 2 December 2016
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Software Engineering
- Vol. 43 (10) , 918-945
Abstract
A glossary is an important part of any software requirements document. By making explicit the technical terms in a domain and providing definitions for them, a glossary helps mitigate imprecision and ambiguity. A key step in building a glossary is to decide upon the terms to include in the glossary and to find any related terms. Doing so manually is laborious, particularly for large requirements documents. In this article, we develop an automated approach for extracting candidate glossary terms and their related terms from natural language requirements documents. Our approach differs from existing work on term extraction mainly in that it clusters the extracted terms by relevance, instead of providing a flat list of terms. We provide an automated, mathematically-based procedure for selecting the number of clusters. This procedure makes the underlying clustering algorithm transparent to users, thus alleviating the need for any user-specified parameters. To evaluate our approach, we report on three industrial case studies, as part of which we also examine the perceptions of the involved subject matter experts about the usefulness of our approach. Our evaluation notably suggests that: (1) Over requirements documents, our approach is more accurate than major generic term extraction tools. Specifically, in our case studies, our approach leads to gains of 20 percent or more in terms of recall when compared to existing tools, while at the same time either improving precision or leaving it virtually unchanged. And, (2) the experts involved in our case studies find the clusters generated by our approach useful as an aid for glossary construction.Keywords
Funding Information
- Luxembourg’s National Research Fund (FNR/P10/03, FNR-6911386)
- European Research Council
- European Union’s Horizon 2020 Research and Innovation Program (694277)
This publication has 64 references indexed in Scilit:
- Supporting concept location through identifier parsing and ontology extractionJournal of Systems and Software, 2013
- A systematic review of transformation approaches between user requirements and analysis modelsRequirements Engineering, 2010
- Assessing traceability of software engineering artifactsRequirements Engineering, 2010
- Improving automated requirements trace retrieval: a study of term-based enhancement methodsEmpirical Software Engineering, 2009
- Requirements for tools for ambiguity identification and measurement in natural language requirements specificationsRequirements Engineering, 2008
- Reasoning about inconsistencies in natural language requirementsACM Transactions on Software Engineering and Methodology, 2005
- Lightweight validation of natural language requirementsSoftware: Practice and Experience, 2001
- Genetic K-means algorithmIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 1999
- The use of a repeated phrase finder in requirements extractionJournal of Systems and Software, 1990
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978