Event Recognition Based on Deep Learning in Chinese Texts
Authors:
Open Access
- 8 August 2016
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 11 (8) , e0160147
Abstract
Event recognition is the most fundamental and critical task in event-based natural language processing systems. Existing event recognition methods based on rules and shallow neural networks have certain limitations. For example, extracting features using methods based on rules is difficult; methods based on shallow neural networks converge too quickly to a local minimum, resulting in low recognition precision. To address these problems, we propose the Chinese emergency event recognition model based on deep learning (CEERM). Firstly, we use a word segmentation system to segment sentences. According to event elements labeled in the CEC 2.0 corpus, we classify words into five categories: trigger words, participants, objects, time and location. Each word is vectorized according to the following six feature layers: part of speech, dependency grammar, length, location, distance between trigger word and core word and trigger word frequency. We obtain deep semantic features of words by training a feature vector set using a deep belief network (DBN), then analyze those features in order to identify trigger words by means of a back propagation neural network. Extensive testing shows that the CEERM achieves excellent recognition performance, with a maximum F-measure value of 85.17%. Moreover, we propose the dynamic-supervised DBN, which adds supervised fine-tuning to a restricted Boltzmann machine layer by monitoring its training performance. Test analysis reveals that the new DBN improves recognition performance and effectively controls the training time. Although the F-measure increases to 88.11%, the training time increases by only 25.35%.Keywords
Funding Information
- National Natural Science Foundation of China (CN) (61305053)
- National Natural Science Foundation of China (61273328)
- National Natural Science Foundation of China (71203135)
This publication has 26 references indexed in Scilit:
- Translation techniques in cross-language information retrievalACM Computing Surveys, 2012
- AskHERMES: An online question answering system for complex clinical questionsJournal of Biomedical Informatics, 2011
- Collection-integral source selection for uncooperative distributed information retrieval environmentsInformation Sciences, 2010
- Chinese Event Extraction Based on Feature WeightingInformation Technology Journal, 2009
- Reducing the Dimensionality of Data with Neural NetworksScience, 2006
- A Fast Learning Algorithm for Deep Belief NetsNeural Computation, 2006
- Ontology-based fuzzy event extraction agent for Chinese e-news summarizationExpert Systems with Applications, 2003
- Hierarchical Bayesian inference in the visual cortexJournal of the Optical Society of America A, 2003
- Training Products of Experts by Minimizing Contrastive DivergenceNeural Computation, 2002
- Efficient Backpropagation Learning Using Optimal Learning Rate and MomentumNeural Networks, 1997