Semiology Extraction and Machine Learning–Based Classification of Electronic Health Records for Patients With Epilepsy: Retrospective Analysis
Open Access
- 17 October 2024
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Medical Informatics
- Vol. 12 (1) , e57727
Abstract
Background: Obtaining and describing semiology efficiently and classifying seizure types correctly are crucial for the diagnosis and treatment of epilepsy. Nevertheless, there exists an inadequacy in related informatics resources and decision support tools. Objective: We developed a symptom entity extraction tool and an epilepsy semiology ontology (ESO) and used machine learning to achieve an automated binary classification of epilepsy in this study. Methods: Using present history data of electronic health records from the Southwest Epilepsy Center in China, we constructed an ESO and a symptom-entity extraction tool to extract seizure duration, seizure symptoms, and seizure frequency from the unstructured text by combining manual annotation with natural language processing techniques. In addition, we achieved automatic classification of patients in the study cohort with high accuracy based on the extracted seizure feature data using multiple machine learning methods. Results: Data included present history from 10,925 cases between 2010 and 2020. Six annotators labeled a total of 2500 texts to obtain 5844 words of semiology and construct an ESO with 702 terms. Based on the ontology, the extraction tool achieved an accuracy rate of 85% in symptom extraction. Furthermore, we trained a stacking ensemble learning model combining XGBoost and random forest with an F1-score of 75.03%. The random forest model had the highest area under the curve (0.985). Conclusions: This work demonstrated the feasibility of natural language processing–assisted structural extraction of epilepsy medical record texts and downstream tasks, providing open ontology resources for subsequent related work.Keywords
This publication has 35 references indexed in Scilit:
- The promises and pitfalls of seizure phenomenologySeizure: European Journal of Epilepsy, 2023
- Development of a natural language processing algorithm to extract seizure types and frequencies from the electronic health recordSeizure: European Journal of Epilepsy, 2022
- The competence of village clinicians in the diagnosis and management of childhood epilepsy in Southwestern China and its determinants: A cross-sectional studyThe Lancet Regional Health - Western Pacific, 2020
- Active deep learning for the identification of concepts and relations in electroencephalography reportsJournal of Biomedical Informatics, 2019
- Teleconference-based education of epileptic seizure semiologyEpilepsy Research, 2018
- Diagnosis of epileptic seizures by community health workers using a mobile app: A comparison with physicians and a neurologistSeizure: European Journal of Epilepsy, 2018
- Interobserver variability of seizure semiology between two neurologist and caregiversSeizure: European Journal of Epilepsy, 2013
- Prevalence of epilepsy in the People's Republic of China: A systematic reviewEpilepsy Research, 2013
- Do epilepsy specialist nurses use a similar history-taking process as consultant neurologists in the differential diagnosis of patients presenting with a first seizure?Seizure: European Journal of Epilepsy, 2011
- The global burden and stigma of epilepsyEpilepsy & Behavior, 2008