Improving postsurgical fall detection for older Americans using LLM-driven analysis of clinical narratives
Preprint
Abstract
Postsurgical falls have significant patient and societal implications but remain challenging to identify and track. Detecting postsurgical falls is crucial to improve patient care for older adults and reduce healthcare costs. Large language models (LLMs) offer a promising solution for reliable and automated fall detection using unstructured data in clinical notes. We tested several LLM prompting approaches to postsurgical fall detection in two different healthcare systems with three open-source LLMs. The Mixtral-8×7B zero-shot had the best performance at Stanford Health Care (PPV = 0.81, recall = 0.67) and the Veterans Health Administration (PPV = 0.93, recall = 0.94). These results demonstrate that LLMs can detect falls with little to no guidance and lay groundwork for applications of LLMs in fall prediction and prevention across many different settings.Keywords
This publication has 14 references indexed in Scilit:
- World guidelines for falls prevention and management for older adults: a global initiativeAge and Ageing, 2022
- A hybrid model to identify fall occurrence from electronic health recordsInternational Journal of Medical Informatics, 2022
- RESEARCHComparing Strategies for Identifying Falls in Older Adult Emergency Department Visits Using EHR DataJournal of the American Geriatrics Society, 2020
- MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health careJournal of the American Medical Informatics Association, 2020
- The global burden of falls: global, regional and national estimates of morbidity and mortality from the Global Burden of Disease Study 2017Injury Prevention, 2020
- Development and validation of a pragmatic natural language processing approach to identifying falls in older adults in the emergency departmentBMC Medical Informatics and Decision Making, 2019
- Medical Costs of Fatal and Nonfatal Falls in Older AdultsJournal of the American Geriatrics Society, 2018
- The CDC Injury Center’s Response to the Growing Public Health Problem of Falls Among Older AdultsAmerican Journal of Lifestyle Medicine, 2015
- Validity of the Morse Fall Scale implemented in an electronic medical record systemJournal of Clinical Nursing, 2013
- Falls in older people: epidemiology, risk factors and strategies for preventionAge and Ageing, 2006