Comorbidity Classification from Clinical Free-Text using Large Language Models: Application to Sleep Disorder Patients
Open Access
- 19 February 2026
- journal article
- research article
- Published by Springer Nature in Journal of Medical Systems
- Vol. 50 (1) , 23
Abstract
Patients presenting to neurology clinics commonly have a complex history of comorbidities and partially documented health trajectories, making it essential to reliably extract comorbidity information from historical records. However, existing extraction methods, ranging from rule-based systems to classical machine learning (ML), often have limited accuracy, scalability, or adaptability across diverse documents. We present a large language model (LLM)–based framework for comorbidity extraction from diagnostic texts, capable of handling various prompt formats and textual sources such as patient history, comorbidities, and sleep assessments. The instruction fine-tuned Mistral-24B (Instruct-2501) model achieves 95% macro classification accuracy and 92% F1 score across six common classes of comorbidities, achieving strong performance that is competitive with metrics reported in prior clinical phenotyping and information extraction studies, while complementing recent transformer-based clinical NLP frameworks. The proposed method extracts comorbidities through a transparent hierarchical approach, thereby supporting clinical analysis and providing interpretable insights for disease modeling and personalized treatment planning in sleep medicine.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- Novel digital markers of sleep dynamics: causal inference approach revealing age and gender phenotypes in obstructive sleep apneaScientific Reports, 2025
- Innovations in otolaryngology using LLM for early detection of sleep-disordered breathingSLAS Technology, 2025
- Extraction of sleep information from clinical notes of Alzheimer’s disease patients using natural language processingJournal of the American Medical Informatics Association, 2024
- Transformers and large language models in healthcare: A reviewArtificial Intelligence in Medicine, 2024
- U-Sleep’s resilience to AASM guidelinesnpj Digital Medicine, 2023
- MIMIC-IV, a freely accessible electronic health record datasetScientific Data, 2023
- Effect of sleep disorders on the risks of cancers and site-specific cancersSleep Medicine, 2022
- BioBERT: a pre-trained biomedical language representation model for biomedical text miningBioinformatics, 2019
- Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics supportJournal of Biomedical Informatics, 2009
- A Simple Algorithm for Identifying Negated Findings and Diseases in Discharge SummariesJournal of Biomedical Informatics, 2001