PRCBERT: Prompt Learning for Requirement Classification using BERT-based Pretrained Language Models
Authors:
Top Cited Papers
Open Access
- 10 October 2022
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-13
Abstract
Software requirement classification is a longstanding and important problem in requirement engineering. Previous studies have applied various machine learning techniques for this problem, including Support Vector Machine (SVM) and decision trees. With the recent popularity of NLP technique, the state-of-the-art approach NoRBERT utilizes the pre-trained language model BERT and achieves a satisfactory performance. However, the dataset PROMISE used by the existing approaches for this problem consists of only hundreds of requirements that are outdated according to today’s technology and market trends. Besides, the NLP technique applied in these approaches might be obsolete. In this paper, we propose an approach of prompt learning for requirement classification using BERT-based pretrained language models (PRCBERT), which applies flexible prompt templates to achieve accurate requirements classification. Experiments conducted on two existing small-size requirement datasets (PROMISE and NFR-Review) and our collected large-scale requirement dataset NFR-SO prove that PRCBERT exhibits moderately better classification performance than NoRBERT and MLM-BERT (BERT with the standard prompt template). On the de-labeled NFR-Review and NFR-SO datasets, Trans_PRCBERT (the version of PRCBERT which is fine-tuned on PROMISE) is able to have a satisfactory zero-shot performance with 53.27% and 72.96% F1-score when enabling a self-learning strategy.Keywords
Funding Information
- Natural Science Foundation of Jiangsu Province of China (BK20201192)
This publication has 28 references indexed in Scilit:
- A review of machine learning algorithms for identification and classification of non-functional requirementsExpert Systems with Applications: X, 2019
- The Effects of Vectorization Methods on Non-Functional Requirements Classification2018
- Study of Various Classifiers for Identification and Classification of Non-functional Requirements2018
- SnorkelProceedings of the VLDB Endowment, 2017
- What Works Better? A Study of Classifying Requirements2017
- Deep Pyramid Convolutional Neural Networks for Text Categorization2017
- Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification2016
- Hierarchical Attention Networks for Document Classification2016
- Semi-Supervised Bootstrapping of Relationship Extractors with Distributional Semantics2015
- Experimentation in Software Engineering2000