SECTOR: A Neural Model for Coherent Topic Segmentation and Classification
Open Access
- 1 November 2019
- journal article
- research article
- Published by MIT Press in Transactions of the Association for Computational Linguistics
- Vol. 7, 169-184
Abstract
When searching for information, a human reader first glances over a document, spots relevant sections, and then focuses on a few sentences for resolving her intention. However, the high variance of document structure complicates the identification of the salient topic of a given section at a glance. To tackle this challenge, we present SECTOR, a model to support machine reading systems by segmenting documents into coherent sections and assigning topic labels to each section. Our deep neural network architecture learns a latent topic embedding over the course of a document. This can be leveraged to classify local topics from plain text and segment a document at topic shifts. In addition, we contribute WikiSection, a publicly available data set with 242k labeled sections in English and German from two distinct domains: diseases and cities. From our extensive evaluation of 20 architectures, we report a highest score of 71.6% F1 for the segmentation and classification of 30 topics from the English city domain, scored by our SECTOR long short-term memory model with Bloom filter embeddings and bidirectional segmentation. This is a significant improvement of 29.5 points F1 over state-of-the-art CNN classifiers with baseline segmentation.Keywords
All Related Versions
This publication has 24 references indexed in Scilit:
- Advances in natural language processingScience, 2015
- FastXML2014
- Head/Tail Breaks: A New Classification Scheme for Data with a Heavy-Tailed DistributionThe Professional Geographer, 2013
- BabelNet: The automatic construction, evaluation and application of a wide-coverage multilingual semantic networkArtificial Intelligence, 2012
- Automatically classifying sentences in full-text biomedical articles into Introduction, Methods, Results and DiscussionBioinformatics, 2009
- Mining Multi-label Data2009
- Finding community structure in networks using the eigenvectors of matricesPhysical Review E, 2006
- Text classification and named entities for new event detection2004
- Learning to Forget: Continual Prediction with LSTMNeural Computation, 2000
- Long Short-Term MemoryNeural Computation, 1997