AttSum: A Deep Attention-Based Summarization Model for Bug Report Title Generation
- 24 January 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Reliability
- Vol. 72 (4) , 1663-1677
Abstract
Concise and precise bug report titles help software developers to capture the highlights of the bug report quickly. Unfortunately, it is common that bug reporters do not create high-quality bug report titles. Recent long short-term memory (LSTM)-based sequence-to-sequence models such as iTAPE were proposed to generate bug report titles automatically, but the text representation method and LSTM employed in such model are difficult to capture the accurate semantic information and draw the global dependencies among tokens effectively. This article proposes a deep attention-based summarization model (i.e., AttSum ) to generate high-quality bug report titles. Specifically, the AttSum model employs the encoder.decoder framework, which utilizes the robustly optimized bidirectional-encoder-representations-from-transformers approach to encode the bug report bodies to capture contextual semantic information better, the stacked transformer decoder to automatically generate titles, and the copy mechanism to handle the rare token problem. To validate the effectiveness of AttSum , we conduct automatic and manual evaluations on 333563 “ $< body, title>$ ” pairs of bug reports and perform a practical analysis of its ability to improve low-quality titles. The result shows that AttSum is superior to the state-of-the-art baselines by a substantial margin both on automatic evaluation metrics (e.g., by 3.4%–58.8% and 7.7%–42.3% in terms of recall-oriented understudy for gisting evaluation in F1 and bilingual evaluation understudy, separately) and three human-set modalities (e.g., by 1.9%–57.5%). Moreover, we analyze the impact of the training data size on AttSum and the results imply that our approach is robust enough to generate much better titles.Keywords
Funding Information
- General Research Fund of the Research Grants Council of Hong Kong (11208017)
- Project of Sanya Yazhou Bay Science and Technology City (SCKJ-JYRC-2022-17)
- City University of Hong Kong (7005028, 7005217, 6000796)
- other industry (9229109, 9229098, 9229029, 9220103, 9220097, 9440227)
- Youth Fund Project of Hainan Natural Science Foundation (622QN344)
- Sanya Science and Education Innovation Park of Wuhan University of Technology (2022KF0020)
This publication has 36 references indexed in Scilit:
- End-to-end attention-based large vocabulary speech recognition2016
- Minimum Risk Training for Neural Machine Translation2016
- Incorporating Copying Mechanism in Sequence-to-Sequence Learning2016
- Aligning Books and Movies: Towards Story-Like Visual Explanations by Watching Movies and Reading Books2015
- EESEN: End-to-end speech recognition using deep RNN models and WFST-based decoding2015
- A Neural Attention Model for Abstractive Sentence Summarization2015
- Using Effect Size—or Why the P Value Is Not EnoughJournal of Graduate Medical Education, 2012
- What makes a good bug report?2008
- ORANGE2004
- BLEU2001