Error Analysis in an Automated Narrative Information Extraction Pipeline
- 10 June 2016
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Intelligence and AI in Games
- Vol. 9 (4) , 342-353
Abstract
In this paper, we present our method for automatically extracting narrative information of characters and their narrative roles from natural language stories. In our corpus of 15 unannotated folk tales, our Voz system identifies 87% of the characters in the stories and correctly assigns 68% of the character roles. To better understand the sources of error in our system, we present an analytical methodology to study how the error is introduced by different modules and how it propagates through the pipeline. This methodology allows us to identify the bottleneck with the largest impact on the final error, which might be different from the module with the largest individual error in isolation. Our methodology can be applied to a wide variety of similar information extraction pipelines.Keywords
This publication has 22 references indexed in Scilit:
- Interleaving ontology-based reasoning and Natural Language Processing for character identification in folktales2014
- A Bayesian Mixed Effects Model of Literary Character2014
- The Stanford CoreNLP Natural Language Processing Toolkit2014
- Towards story-based content generation: From plot-points to maps2013
- Say AnythingACM Transactions on Interactive Intelligent Systems, 2012
- The Importance of Syntactic Parsing and Inference in Semantic Role LabelingComputational Linguistics, 2008
- Multistrategy Learning with Introspective Meta-Explanations1992
- Induction of decision treesMachine Learning, 1986
- Topological ordering of a list of randomly-numbered elements of a networkCommunications of the ACM, 1961
- THE DISTRIBUTION OF THE FLORA IN THE ALPINE ZONE.1New Phytologist, 1912