Language Models Are An Effective Patient Representation Learning Technique For Electronic Health Record Data
Authors:
- Ethan SteinbergESEthan Steinberg
- Ken JungKJKen Jung
- Jason A. FriesJFJason A. Fries
- Conor K. CorbinCCConor K. Corbin
- Stephen R. PfohlSPStephen R. Pfohl
- Nigam H. ShahNSNigam H. Shah
Preprint
Abstract
Widespread adoption of electronic health records (EHRs) has fueled the development of using machine learning to build prediction models for various clinical outcomes. This process is often constrained by having a relatively small number of patient records for training the model. We demonstrate that using patient representation schemes inspired from techniques in natural language processing can increase the accuracy of clinical prediction models by transferring information learned from the entire patient population to the task of training a specific model, where only a subset of the population is relevant. Such patient representation schemes enable a 3.5% mean improvement in AUROC on five prediction tasks compared to standard baselines, with the average improvement rising to 19% when only a small number of patient records are available for training the clinical prediction model.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- What Do We Do After the Pilot Is Done? Implementation of a Hospital Early Warning System at ScaleThe Joint Commission Journal on Quality and Patient Safety, 2020
- Axes of a revolution: challenges and promises of big data in healthcareNature Medicine, 2020
- Do no harm: a roadmap for responsible machine learning for health careNature Medicine, 2019
- Deep learning and alternative learning strategies for retrospective real-world clinical datanpj Digital Medicine, 2019
- Finding missed cases of familial hypercholesterolemia in health systems using machine learningnpj Digital Medicine, 2019
- A call for deep-learning healthcareNature Medicine, 2019
- Using recurrent neural network models for early detection of heart failure onsetJournal of the American Medical Informatics Association, 2016
- Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic reviewJournal of the American Medical Informatics Association, 2016
- Deep Patient: An Unsupervised Representation to Predict the Future of Patients from the Electronic Health RecordsScientific Reports, 2016
- The Unified Medical Language System (UMLS): integrating biomedical terminologyNucleic Acids Research, 2004