Text Classification Research Based on Bert Model and Bayesian Network
Authors:
- 1 November 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5842-5846
Abstract
The Bert model is a pre-training model based on deep learning. It has refreshed the best performance of 11 NLP missions as soon as it appears, and it also has a wide range of applications. The text data of people's livelihood governance is huge, and there is a large amount of unstructured data, which makes the traditional text analysis and mining technology increase in the space-time complexity of computing; so it is very important to choose appropriate text classification technology. Here we propose to use the Bert model in combination with the Bayesian network to achieve one new classification of text. That is, the Bayesian network is used to perform the classification of two categories first, and we can get the approximate category range of each text, and then the Bert model is used to classify the text into specific categories. The combination of these two methods can greatly reduce the errors caused by the classification defects of using only one of the methods. Thereby achieving an improvement in the accuracy of text classification.Keywords
This publication has 4 references indexed in Scilit:
- kNN-IS: An Iterative Spark-based design of the k-Nearest Neighbors classifier for big dataKnowledge-Based Systems, 2017
- A Bayesian Classification Approach Using Class-Specific Features for Text CategorizationIEEE Transactions on Knowledge and Data Engineering, 2016
- Editing training data for multi-label classification with the k-nearest neighbor rulePattern Analysis and Applications, 2015
- Discrete Bayesian Network ClassifiersACM Computing Surveys, 2014