MULTI‐DOCUMENT SUMMARIZATION OF EVALUATIVE TEXT
- 23 April 2012
- journal article
- Published by Wiley in Computational Intelligence
- Vol. 29 (4) , 545-576
Abstract
In many decision‐making scenarios, people can benefit from knowing what other people's opinions are. As more and more evaluative documents are posted on the Web, summarizing these useful resources becomes a critical task for many organizations and individuals. This paper presents a framework for summarizing a corpus of evaluative documents about a single entity by a natural language summary. We propose two summarizers: an extractive summarizer and an abstractive one. As an additional contribution, we show how our abstractive summarizer can be modified to generate summaries tailored to a model of the user preferences that is solidly grounded in decision theory and can be effectively elicited from users. We have tested our framework in three user studies. In the first one, we compared the two summarizers. They performed equally well relative to each other quantitatively, while significantly outperforming a baseline standard approach to multidocument summarization. Trends in the results as well as qualitative comments from participants suggest that the summarizers have different strengths and weaknesses. After this initial user study, we realized that the diversity of opinions expressed in the corpus (i.e., its controversiality) might play a critical role in comparing abstraction versus extraction. To clearly pinpoint the role of controversiality, we ran a second user study in which we controlled for the degree of controversiality of the corpora that were summarized for the participants. The outcome of this study indicates that for evaluative text abstraction tends to be more effective than extraction, particularly when the corpus is controversial. In the third user study we assessed the effectiveness of our user tailoring strategy. The results of this experiment confirm that user tailored summaries are more informative than untailored ones.Keywords
This publication has 17 references indexed in Scilit:
- Opinion Mining and Sentiment AnalysisFoundations and Trends® in Information Retrieval, 2008
- User-model based personalized summarizationInformation Processing & Management, 2007
- Generating and evaluating evaluative argumentsArtificial Intelligence, 2006
- RECOGNIZING STRONG AND WEAK OPINION CLAUSESComputational Intelligence, 2006
- Customization in a unified framework for summarizing medical literatureArtificial Intelligence in Medicine, 2005
- Centroid-based summarization of multiple documentsInformation Processing & Management, 2004
- Generation and evaluation of user tailored responses in multimodal dialogueCognitive Science, 2004
- The influence of online product recommendations on consumers’ online choicesJournal of Retailing, 2004
- Generating Indicative-Informative Summaries with SumUMComputational Linguistics, 2002
- SMARTS and SMARTER: Improved Simple Methods for Multiattribute Utility MeasurementOrganizational Behavior and Human Decision Processes, 1994