Vedant Jain
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Vedant Jain has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Alexandra T. Strauss
Division of Gastroenterology & Hepatology, Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, MD. USA; Malone Center of Engineering in Healthcare, Johns Hopkins Whiting School of Engineering, Baltimore, MD. USA
1 shared publication - Eili Y. Klein
Johns Hopkins University School of Medicine, Department of Emergency Medicine, Baltimore, Maryland
1 shared publication - Jeremiah S. Hinson
Department of Emergency Medicine, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
1 shared publication - Mark Dredze
Johns Hopkins University, Baltimore, MD, USA
1 shared publication - Nicholas W. Rizer
Department of Emergency Medicine, Johns Hopkins University School of Medicine, Baltimore, MD; Department of Emergency Medicine, University of Maryland School of Medicine, Baltimore, MD
1 shared publication - Stephen Kwak
Department of Radiology, Baltimore, USA
1 shared publication
Latest Publications
- Open Access
- 19 February 2025
- Vol. 9 (3)
Automated identification of incidental hepatic steatosis on Emergency Department imaging using large language models
Hepatic steatosis is a precursor to more severe liver disease, increasing morbidity and mortality risks. In the Emergency Department, routine abdominal imaging often reveals incidental hepatic steatosis that goes undiagnosed due to the acute nature of encounters. Imaging reports in the electronic health record contain valuable information not easily accessible as discrete data elements. We hypothesized that large language models could reliably detect hepatic steatosis from reports without extensive natural language processing training. We identified 200 adults who had CT abdominal imaging in the Emergency Department between August 1, 2016, and December 31, 2023. Using text from imaging reports and structured prompts, 3 Azure OpenAI models (ChatGPT 3.5, 4, 4o) identified patients with hepatic steatosis. We evaluated model performance regarding accuracy, inter-rater reliability, sensitivity, and specificity compared to physician reviews. The accuracy for the models was 96.2% for v3.5, 98.3% for v4, and 98.8% for v4o. Inter-rater reliability ranged from 0.99 to 1.00 across 10 iterations. Mean model confidence scores were 2.9 (SD 0.8) for v3.5, 3.9 (SD 0.3) for v4, and 4.0 (SD 0.07) for v4o. Incorrect evaluations were 76 (3.8%) for v3.5, 34 (1.7%) for v4, and 25 (1.3%) for v4o. All models showed sensitivity and specificity above 0.9. Large language models can assist in identifying incidental conditions from imaging reports that otherwise may be missed opportunities for early disease intervention. Large language models are a democratization of natural language processing by allowing for a user-friendly, expansive analyses of electronic medical records without requiring the development of complex natural language processing models.
- 19 February 2025
- Vol. 9 (3)
Open AccessAutomated identification of incidental hepatic steatosis on Emergency Department imaging using large language models
Hepatic steatosis is a precursor to more severe liver disease, increasing morbidity and mortality risks. In the Emergency Department, routine abdominal imaging often reveals incidental hepatic steatosis that goes undiagnosed due to the acute nature of encounters. Imaging reports in the electronic health record contain valuable information not easily accessible as discrete data elements. We hypothesized that large language models could reliably detect hepatic steatosis from reports without extensive natural language processing training. We identified 200 adults who had CT abdominal imaging in the Emergency Department between August 1, 2016, and December 31, 2023. Using text from imaging reports and structured prompts, 3 Azure OpenAI models (ChatGPT 3.5, 4, 4o) identified patients with hepatic steatosis. We evaluated model performance regarding accuracy, inter-rater reliability, sensitivity, and specificity compared to physician reviews. The accuracy for the models was 96.2% for v3.5, 98.3% for v4, and 98.8% for v4o. Inter-rater reliability ranged from 0.99 to 1.00 across 10 iterations. Mean model confidence scores were 2.9 (SD 0.8) for v3.5, 3.9 (SD 0.3) for v4, and 4.0 (SD 0.07) for v4o. Incorrect evaluations were 76 (3.8%) for v3.5, 34 (1.7%) for v4, and 25 (1.3%) for v4o. All models showed sensitivity and specificity above 0.9. Large language models can assist in identifying incidental conditions from imaging reports that otherwise may be missed opportunities for early disease intervention. Large language models are a democratization of natural language processing by allowing for a user-friendly, expansive analyses of electronic medical records without requiring the development of complex natural language processing models.