Dual Encoding for Abstractive Text Summarization
Open Access
- 2 November 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 50 (3) , 985-996
Abstract
Recurrent neural network-based sequence-to-sequence attentional models have proven effective in abstractive text summarization. In this paper, we model abstractive text summarization using a dual encoding model. Different from the previous works only using a single encoder, the proposed method employs a dual encoder including the primary and the secondary encoders. Specifically, the primary encoder conducts coarse encoding in a regular way, while the secondary encoder models the importance of words and generates more fine encoding based on the input raw text and the previously generated output text summarization. The two level encodings are combined and fed into the decoder to generate more diverse summary that can decrease repetition phenomenon for long sequence generation. The experimental results on two challenging datasets (i.e., CNN/DailyMail and DUC 2004) demonstrate that our dual encoding model performs against existing methods.Keywords
Funding Information
- National Natural Science Foundation of China (61807033)
This publication has 19 references indexed in Scilit:
- End-to-end attention-based large vocabulary speech recognition2016
- Abstractive Sentence Summarization with Attentive Recurrent Neural Networks2016
- Show and tell: A neural image caption generator2015
- LCSTS: A Large Scale Chinese Short Text Summarization Dataset2015
- Sentence Compression by Deletion with LSTMs2015
- A Neural Attention Model for Abstractive Sentence Summarization2015
- HEADS: Headline Generation as Sequence Prediction Using an Abstract Feature-Rich Space2015
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
- DUC in contextInformation Processing & Management, 2007
- Automatic Text Summarization Using a Machine Learning Approach2002