Representing Discourse Coherence: A Corpus-Based Study
Authors:
Open Access
- 1 June 2005
- journal article
- Published by MIT Press in Computational Linguistics
- Vol. 31 (2) , 249-287
Abstract
This article aims to present a set of discourse structure relations that are easy to code and to develop criteria for an appropriate data structure for representing these relations. Discourse structure here refers to informational relations that hold between sentences in a discourse. The set of discourse relations introduced here is based on Hobbs (1985). We present a method for annotating discourse coherence structures that we used to manually annotate a database of 135 texts from the Wall Street Journal and the AP Newswire. Alltexts were independently annotated by two annotators. Kappa values of greater than 0.8 indicated good interannotator agreement. We furthermore present evidence that trees are not a descriptively adequate data structure for representing discourse structure: In coherence structures of naturally occurring texts, we found many different kinds of crossed dependencies, as well as many nodes with multiple parents. The claims are supported by statistical results from our hand-annotated database of 135 texts.Keywords
This publication has 5 references indexed in Scilit:
- Anaphora and Discourse StructureComputational Linguistics, 2003
- Temporal interpretation, discourse relations and commonsense entailmentLinguistics and Philosophy, 1993
- Interpretation as abductionArtificial Intelligence, 1993
- Graphical Models for Associations between Variables, some of which are Qualitative and some QuantitativeThe Annals of Statistics, 1989
- Rhetorical Structure Theory: Toward a functional theory of text organizationText & Talk, 1988