Text Classification of Civil Aviation Safety Supervision Based on Multi-Model Fusion
Open Access
- 16 August 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 438-448
Abstract
This study proposed a novel method for text classification and co-occurrence network analysis based on 19,940 civil aviation regulatory records to improve regulatory methods and achieve precise and differentiated supervision. First, a hybrid deep-learning model combining BERT (bidirectional encoder representations from transformers) and TextCNN (text convolutional neural network) was developed to classify civil aviation regulatory records. Furthermore, a topic-based term frequency-inverse word frequency (TF-IWF) algorithm was used to extract key knowledge for each topic. Finally, a co-occurrence network graph of civil aviation safety supervision knowledge was drawn to analyze the intrinsic connections among various pieces of knowledge. The results showed that the BERT-TextCNN model outperformed 17 other classification models built using text representation methods, including the BERT, Word2vec, and Char models, and six neural networks, including the CNN, RCNN, DPCNN, Transformer, BiLSTM, and TextCNN models. The BERT-TextCNN model achieved macro precision, macro recall, and macro F1 score of 97.26%, 96.01%, and 96.61%, respectively. Furthermore, the topic-based civil aviation safety supervision knowledge-mining method effectively highlights key aspects of supervision work and presents a relationship network graph encompassing knowledge areas such as airports and equipment. This approach provides inspectors with a scientific basis for categorizing problem types and offers insights for an in-depth analysis of them. Additionally, it can facilitate the supervision and inspection of key regulatory matters, thereby improving regulatory efficiency.Keywords
This publication has 9 references indexed in Scilit:
- Natural language inference model for customer advocacy detection in online customer engagementMachine Learning, 2023
- A novel multi-layer feature fusion-based BERT-CNN for sentence representation learning and classificationRobotic Intelligence and Automation, 2023
- An improved approach to Arabic news classification based on hyperparameter tuning of machine learning algorithmsJournal of Engineering Research, 2023
- Classification of Seismaesthesia Information and Seismic Intensity Assessment by Multi-Model CouplingISPRS International Journal of Geo-Information, 2023
- Integrated BERT embeddings, BiLSTM-BiGRU and 1-D CNN model for binary sentiment classification analysis of movie reviewsMultimedia Tools and Applications, 2022
- DCCL: Dual-channel hybrid neural network combined with self-attention for text classificationMathematical Biosciences and Engineering, 2022
- Network text sentiment analysis method combining LDA text representation and GRU-CNNPersonal and Ubiquitous Computing, 2018
- Text Mining: Use of TF-IDF to Examine the Relevance of Words to DocumentsInternational Journal of Computer Applications, 2018
- Convolutional Neural Networks for Sentence Classification2014