Incorporating External Knowledge into Unsupervised Graph Model for Document Summarization
Open Access
- 17 September 2020
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 9 (9) , 1520
Abstract
Supervised neural network models have achieved outstanding performance in the document summarization task in recent years. However, it is hard to get enough labeled training data with a high quality for these models to generate different types of summaries in reality. In this work, we mainly focus on improving the performance of the popular unsupervised Textrank algorithm that requires no labeled training data for extractive summarization. We first modify the original edge weight of Textrank to take the relative position of sentences into account, and then combine the output of the improved Textrank with K-means clustering to improve the diversity of generated summaries. To further improve the performance of our model, we innovatively incorporate external knowledge from open-source knowledge graphs into our model by entity linking. We use the knowledge graph sentence embedding and the tf-idf embedding as the input of our improved Textrank, and get the final score for each sentence by linear combination. Evaluations on the New York Times data set show the effectiveness of our knowledge-enhanced approach. The proposed model outperforms other popular unsupervised models significantly.Keywords
Funding Information
- National Key R&D Program of China (2018YFB1003801)
This publication has 21 references indexed in Scilit:
- Knowledge-guided unsupervised rhetorical parsing for text summarizationInformation Systems, 2020
- A Topical Category-Aware Neural Text SummarizerApplied Sciences, 2020
- A Text Abstraction Summary Model Based on BERT Word Embedding and Reinforcement LearningApplied Sciences, 2019
- Multi-Source Pointer Network for Product Title Summarization2018
- Graph-Based Text Summarization Using Modified TextRank2018
- Neural Question Generation from Text: A Preliminary Study2018
- An extractive text summarization technique for Bengali document(s) using K-means clustering algorithm2017
- Unsupervised Extraction of Diagnosis Codes from EMRs Using Knowledge-Based and Extractive Text Summarization Techniques2013
- LexRank: Graph-based Lexical Centrality as Salience in Text SummarizationJournal of Artificial Intelligence Research, 2004
- Centroid-based summarization of multiple documentsInformation Processing & Management, 2004