ILP-based Compressive Speech Summarization with Content Word Coverage Maximization and Its Oracle Performance Analysis
Authors:
- 1 May 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7190-7194
Abstract
We propose an integer linear programming (ILP)-based compressive speech summarization method that maximizes the coverage of content words in a resultant summary. It is an unsupervised method and, under the designed constraints, it performs a single-step globally optimal summarization of a given long speech recording, which is decoded as a confusion network form of an automatic speech recognition (ASR) hypothesis sequence. It selects as many different content words as possible from the speech input that inevitably includes a high level of redundancy (e.g. the repetition of the same word) under a given length constraint. In experiments using a lecture speech corpus, we obtained higher summarization performance in terms of ROUGE scores than with a baseline extractive summarization method. We further conduct experimental analyses to obtain the oracle (upper bound) performance of the summarization methods. The analysis results show that the oracle performance is very high even though the ASR hypotheses include recognition errors. It is significantly higher than the system performance and, in addition, the oracle performance of the compressive method is significantly higher than that of the extractive method. These results confirm that our method is a promising approach.Keywords
This publication has 30 references indexed in Scilit:
- Improved spoken document summarization with coverage modeling techniques2016
- Incorporating proximity information in relevance language modeling for extractive speech summarization2015
- Incorporating paragraph embeddings and density peaks clustering for spoken document summarization2015
- Spoken Content Retrieval—Beyond Cascading Speech Recognition with Text RetrievalIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2015
- The use of semantic and acoustic features for open-domain TED talk summarization2014
- Sentence modeling for extractive speech summarization2013
- From Text to Speech Summarization2006
- Speech-to-Text and Speech-to-Speech Summarization of Spontaneous SpeechIEEE Transactions on Speech and Audio Processing, 2004
- Finding consensus in speech recognition: word error minimization and other applications of confusion networksComputer Speech & Language, 2000
- The use of MMR, diversity-based reranking for reordering documents and producing summaries1998