A Dual Attention Encoder-Decoder Text Summarization Model
Authors:
- Nada Ali HakamiNHNada Ali Hakami
- Hanan Ahmed Hosni MahmoudHMHanan Ahmed Hosni Mahmoud
Open Access
- 1 January 2023
- journal article
- research article
- Published by Tech Science Press in Computers, Materials & Continua
- Vol. 74 (2) , 3697-3710
Abstract
A worthy text summarization should represent the fundamental content of the document. Recent studies on computerized text summarization tried to present solutions to this challenging problem. Attention models are employed extensively in text summarization process. Classical attention techniques are utilized to acquire the context data in the decoding phase. Nevertheless, without real and efficient feature extraction, the produced summary may diverge from the core topic. In this article, we present an encoder-decoder attention system employing dual attention mechanism. In the dual attention mechanism, the attention algorithm gathers main data from the encoder side. In the dual attention model, the system can capture and produce more rational main content. The merging of the two attention phases produces precise and rational text summaries. The enhanced attention mechanism gives high score to text repetition to increase phrase score. It also captures the relationship between phrases and the title giving them higher score. We assessed our proposed model with or without significance optimization using ablation procedure. Our model with significance optimization achieved the highest performance of 96.7% precision and the least CPU time among other models in both training and sentence extraction.Keywords
This publication has 23 references indexed in Scilit:
- Automatic Arabic text summarization: a surveyArtificial Intelligence Review, 2015
- Deep learningNature, 2015
- Enhancing diversity and coverage of document summaries through subspace clustering and clustering-based optimizationInformation Sciences, 2014
- Automatic Single Document Text Summarization Using Key Concepts in DocumentsJournal of Information Processing Systems, 2013
- An Approach to Automatic Text Summarization Using Simplified Lesk Algorithm and WordnetInternational Journal of Control Theory and Computer Modeling, 2013
- Exploiting relevance, coverage, and novelty for query-focused multi-document summarizationKnowledge-Based Systems, 2013
- Multiobjective evolutionary algorithms: A survey of the state of the artSwarm and Evolutionary Computation, 2011
- GA, MR, FFNN, PNN and GMM based models for automatic text summarizationComputer Speech & Language, 2009
- Centroid-based summarization of multiple documentsInformation Processing & Management, 2004
- Efficiently Computed Lexical Chains as an Intermediate Representation for Automatic Text SummarizationComputational Linguistics, 2002