Transforming healthcare documentation: harnessing the potential of AI to generate discharge summaries
Open Access
- 12 September 2023
- journal article
- research article
- Published by Royal College of General Practitioners in BJGP Open
- Vol. 8 (1)
Abstract
Background: Hospital discharge summaries play an essential role in informing GPs of recent admissions to ensure excellent continuity of care and prevent adverse events; however, they are notoriously poorly written, time-consuming, and can result in delayed discharge.Aim: To evaluate the potential of artificial intelligence (AI) to produce high-quality discharge summaries equivalent to the level of a doctor who has completed the UK Foundation Programme.Design & setting: Feasibility study using 25 mock patient vignettes.Method: Twenty-five mock patient vignettes were written by the authors. Five junior doctors wrote discharge summaries from the case vignettes (five each). The same case vignettes were input into ChatGPT. In total, 50 discharge summaries were generated; 25 by Al and 25 by junior doctors. Quality and suitability were determined through both independent GP evaluators and adherence to a minimum dataset.Results: Of the 25 AI-written discharge summaries 100% were deemed by GPs to be of an acceptable quality compared with 92% of the junior doctor summaries. They both showed a mean compliance of 97% with the minimum dataset. In addition, the ability of GPs to determine if the summary was written by ChatGPT was poor, with only a 60% accuracy of detection. Similarly, when run through an AI-detection tool all were recognised as being very unlikely to be written by AI.Conclusion: AI has proven to produce discharge summaries of equivalent quality to a junior doctor who has completed the UK Foundation Programme; however, larger studies with real-world patient data with NHS-approved AI tools will need to be conducted.Keywords
This publication has 18 references indexed in Scilit:
- Using ChatGPT to write patient clinic lettersThe Lancet Digital Health, 2023
- ChatGPT: the future of discharge summaries?The Lancet Digital Health, 2023
- Health secretary sets new digital targets for NHS2022
- Danger in discharge summaries: abbreviations create confusion for both author and recipientInternal Medicine Journal, 2021
- Automated Classification of Skin Lesions: From Pixels to PracticeJournal of Investigative Dermatology, 2018
- Investigating the impacting factors for the healthcare professionals to adopt artificial intelligence-based medical diagnosis support system (AIMDSS)Annals of Operations Research, 2018
- Lancet: a high precision medication event extraction system for clinical textJournal of the American Medical Informatics Association, 2010
- Accuracy of medication documentation in hospital discharge summaries: A retrospective analysis of medication transcription errors in manual and electronic discharge summariesInternational Journal of Medical Informatics, 2010
- Deficits in Communication and Information Transfer Between Hospital-Based and Primary Care PhysiciansJAMA, 2007
- Establishing Moore's LawIEEE Annals of the History of Computing, 2006