Sen Yang
Research Subjects
Research Interests
Sen Yang has a total of 3 co-authors. Here are the top co-authors by number of shared publications:
- Chao Luo
TRIP.COM, China
1 shared publication - Xiaolin Jiang
TRIP.COM, China
1 shared publication - Zi Chen
University of New South Wales
1 shared publication
Latest Publications
- Open Access
- 23 December 2022
- Published by Association for Computing Machinery (ACM)
- p. 1-5
Gap Sentences Generation with TextRank for Chinese Text Summarization
Recently Transformer-based pre-trained models have become a new paradigm for text summarization, and one of the milestones is PEGASUS. It suggests the pre-training objective Gap Sentences Generation designed for summarization. However, the ROUGE1-F1-based strategy in Gap Sentences Generation is unfavorable to Chinese text summarization, considering that unigram is not the basic semantic unit of Chinese in most cases. Furthermore, ROUGE1-F1 is based upon the co-occurrences of the unigrams other than distributional semantics such as word or sentence representations. Accordingly, the gap sentences are evaluated on a biased basis and thus the performance of GSG objective pre-training is hampered. In this work, we propose an improved GSG objective that upgrades the ROUGE1-F1-based strategy with TextRank. In TextRank, the texts are first segmented to extract semantically meaningful words and form distributional representations of sentences. The significance of a sentence is assessed in light of its cosine similarity with representations of the neighboring sentences in a graph. GSG with TextRank exhibits remarkable performance gains on the LCSTS dataset, and employment of R-Drop further boosts the improvements.
- 23 December 2022
- Published by Association for Computing Machinery (ACM)
- p. 1-5
Open AccessGap Sentences Generation with TextRank for Chinese Text Summarization
Recently Transformer-based pre-trained models have become a new paradigm for text summarization, and one of the milestones is PEGASUS. It suggests the pre-training objective Gap Sentences Generation designed for summarization. However, the ROUGE1-F1-based strategy in Gap Sentences Generation is unfavorable to Chinese text summarization, considering that unigram is not the basic semantic unit of Chinese in most cases. Furthermore, ROUGE1-F1 is based upon the co-occurrences of the unigrams other than distributional semantics such as word or sentence representations. Accordingly, the gap sentences are evaluated on a biased basis and thus the performance of GSG objective pre-training is hampered. In this work, we propose an improved GSG objective that upgrades the ROUGE1-F1-based strategy with TextRank. In TextRank, the texts are first segmented to extract semantically meaningful words and form distributional representations of sentences. The significance of a sentence is assessed in light of its cosine similarity with representations of the neighboring sentences in a graph. GSG with TextRank exhibits remarkable performance gains on the LCSTS dataset, and employment of R-Drop further boosts the improvements.