Adapting Large Language Models for Automated Summarisation of Electronic Medical Records in Clinical Coding
Open Access
- 24 September 2024
- book chapter
- Published by IOS Press
- Vol. 318, 24-29
Abstract
Encapsulating a patient’s clinical narrative into a condensed, informative summary is indispensable to clinical coding. The intricate nature of the clinical text makes the summarisation process challenging for clinical coders. Recent developments in large language models (LLMs) have shown promising performance in clinical text summarisation, particularly in radiology and echocardiographic reports, after adaptation to the clinical domain. To explore the summarisation potential of clinical domain adaptation of LLMs, a clinical text dataset, consisting of electronic medical records paired with “Brief Hospital Course” from the MIMIC-III database, was curated. Two open-source LLMs were then fine-tuned, one pre-trained on biomedical datasets and another on a general-content domain on the curated clinical dataset. The performance of the fine-tuned models against their base models were evaluated. The model pre-trained on biomedical data demonstrated superior performance after clinical domain adaptation. This finding highlights the potential benefits of adapting LLMs pre-trained on a related domain over a more generalised domain and suggests the possible role of clinically adapted LLMs as an assistive tool for clinical coders. Future work should explore adapting more advanced models to enhance model performance in higher-quality clinical datasets.Keywords
This publication has 14 references indexed in Scilit:
- Radiology-GPT: A large language model for radiologyMeta-Radiology, 2025
- BUILDING ECHOGPT: A LARGE LANGUAGE MODEL FOR ECHOCARDIOGRAPHY REPORT SUMMARIZATIONJACC, 2025
- Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and BeyondACM Transactions on Knowledge Discovery From Data, 2024
- MedAlign: A Clinician-Generated Dataset for Instruction Following with Electronic Medical RecordsProceedings of the AAAI Conference on Artificial Intelligence, 2024
- SPeC: A Soft Prompt-Based Calibration on Performance Variability of Large Language Model in Clinical Notes SummarizationJournal of Biomedical Informatics, 2024
- DRG-LLaMA : tuning LLaMA model to predict diagnosis-related group for hospitalized patientsnpj Digital Medicine, 2024
- Evaluating large language models on medical evidence summarizationnpj Digital Medicine, 2023
- Discharge summary hospital course summarisation of in patient Electronic Health Record text with clinical concept guided deep pre-trained Transformer modelsJournal of Biomedical Informatics, 2023
- MIMIC-III, a freely accessible critical care databaseScientific Data, 2016
- MIMIC-III Clinical Database