An Improved Double Channel Long Short-Term Memory Model for Medical Text Classification
Open Access
- 23 February 2021
- journal article
- research article
- Published by Wiley in Journal of Healthcare Engineering
- Vol. 2021, 1-8
Abstract
There are a large number of symptom consultation texts in medical and healthcare Internet communities, and Chinese health segmentation is more complex, which leads to the low accuracy of the existing algorithms for medical text classification. The deep learning model has advantages in extracting abstract features of text effectively. However, for a large number of samples of complex text data, especially for words with ambiguous meanings in the field of Chinese medical diagnosis, the word-level neural network model is insufficient. Therefore, in order to solve the triage and precise treatment of patients, we present an improved Double Channel (DC) mechanism as a significant enhancement to Long Short-Term Memory (LSTM). In this DC mechanism, two channels are used to receive word-level and char-level embedding, respectively, at the same time. Hybrid attention is proposed to combine the current time output with the current time unit state and then using attention to calculate the weight. By calculating the probability distribution of each timestep input data weight, the weight score is obtained, and then weighted summation is performed. At last, the data input by each timestep is subjected to trade-off learning to improve the generalization ability of the model learning. Moreover, we conduct an extensive performance evaluation on two different datasets: cMedQA and Sentiment140. The experimental results show that the DC-LSTM model proposed in this paper has significantly superior accuracy and ROC compared with the basic CNN-LSTM model.Keywords
Funding Information
- Ministry of Science and Technology of the People's Republic of China (YFE0101000, MF1908, MF1809, 20A520008)
- Foundation of MACAU (YFE0101000, MF1908, MF1809, 20A520008)
- Key Scientific Research Project of Colleges and Universities in Henan Province (YFE0101000, MF1908, MF1809, 20A520008)
This publication has 8 references indexed in Scilit:
- Automated diagnosis of epilepsy from EEG signals using ensemble learning approachPattern Recognition Letters, 2020
- Fusing Visual Attention CNN and Bag of Visual Words for Cross-Corpus Speech Emotion RecognitionSensors, 2020
- Underwater Image Processing and Object Detection Based on Deep CNN MethodJournal of Sensors, 2020
- Outpatient Text Classification Using Attention-Based Bidirectional LSTM for Robot-Assisted Servicing in HospitalInformation, 2020
- Dynamic control flow in large-scale machine learning2018
- Chinese Medical Question Answer Matching Using End-to-End Character-Level Multi-Scale CNNsApplied Sciences, 2017
- Framewise phoneme classification with bidirectional LSTM and other neural network architecturesNeural Networks, 2005
- A survey of decision tree classifier methodologyIEEE Transactions on Systems, Man, and Cybernetics, 1991