Feature-Enhanced Nonequilibrium Bidirectional Long Short-Term Memory Model for Chinese Text Classification
Open Access
- 3 November 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 199629-199637
Abstract
This article proposes a model for Chinese text classification based on a feature-enhanced nonequilibrium bidirectional long short-term memory (Bi-LSTM) network that analyzes Chinese text information in depth and improves the accuracy of text classification. First, the bidirectional encoder representations from transformers model was used to vectorize the original Chinese corpus and extract preliminary semantic features. Then, a nonequilibrium Bi-LSTM network was applied to increase the weight of text information containing important semantics and further improve the effects of the key features in Chinese text classification. Simultaneously, a hierarchical attention mechanism was used to widen the gap between the important and unimportant data. Finally, the softmax function was used for classification. By comparing the classification performance of the proposed scheme with those of various other models, it was observed that the model substantially improved the precision of Chinese text classification and had a strong ability to recognize Chinese text features. The model achieved 97% precision on the experimental dataset.Keywords
Funding Information
- National Natural Science Foundation of China (41671345, 62001238)
This publication has 14 references indexed in Scilit:
- Improving sentiment analysis via sentence type classification using BiLSTM-CRF and CNNExpert Systems with Applications, 2017
- Attention-based LSTM Network for Cross-Lingual Sentiment Classification2016
- Dependency Sensitive Convolutional Neural Networks for Modeling Sentences and Documents2016
- Hierarchical Attention Networks for Document Classification2016
- Multi-Timescale Long Short-Term Memory Neural Network for Modelling Sentences and Documents2015
- Effective Approaches to Attention-based Neural Machine Translation2015
- Long Short-Term Memory Neural Networks for Chinese Word Segmentation2015
- Deep Unordered Composition Rivals Syntactic Methods for Text Classification2015
- Glove: Global Vectors for Word Representation2014
- The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem SolutionsInternational Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 1998