Extracting structured information from unstructured histopathology reports using generative pre‐trained transformer 4 ( GPT ‐4)
Top Cited Papers
Open Access
- 14 December 2023
- journal article
- research article
- Published by Wiley in The Journal of Pathology
- Vol. 262 (3) , 310-319
Abstract
Deep learning applied to whole‐slide histopathology images (WSIs) has the potential to enhance precision oncology and alleviate the workload of experts. However, developing these models necessitates large amounts of data with ground truth labels, which can be both time‐consuming and expensive to obtain. Pathology reports are typically unstructured or poorly structured texts, and efforts to implement structured reporting templates have been unsuccessful, as these efforts lead to perceived extra workload. In this study, we hypothesised that large language models (LLMs), such as the generative pre‐trained transformer 4 (GPT‐4), can extract structured data from unstructured plain language reports using a zero‐shot approach without requiring any re‐training. We tested this hypothesis by utilising GPT‐4 to extract information from histopathological reports, focusing on two extensive sets of pathology reports for colorectal cancer and glioblastoma. We found a high concordance between LLM‐generated structured data and human‐generated structured data. Consequently, LLMs could potentially be employed routinely to extract ground truth data for machine learning from unstructured pathology reports in the future. © 2023 The Authors. The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.Keywords
Funding Information
- Deutscher Akademischer Austauschdienst (57616814)
- National Institute for Health and Care Research (NIHR213331)
- Leeds Biomedical Research Centre
- Deutsche Forschungsgemeinschaft (FO 942/2‐1, NE 2136/3‐1, TR 1700/7‐1)
This publication has 13 references indexed in Scilit:
- Artificial intelligence in histopathology: enhancing cancer research and clinical oncologyNature Cancer, 2022
- Artificial intelligence to identify genetic alterations in conventional histopathologyThe Journal of Pathology, 2022
- Automated Extraction of Tumor Staging and Diagnosis Information From Surgical Pathology ReportsJCO Clinical Cancer Informatics, 2021
- BRAIN UK: Accessing NHS tissue archives for neuroscience researchNeuropathology and Applied Neurobiology, 2021
- Dataset for Pathology Reporting of Colorectal CancerAnnals of Surgery, 2021
- Deep learning in histopathology: the path to the clinicNature Medicine, 2021
- Identification of barriers and facilitators in nationwide implementation of standardized structured reporting in pathology: a mixed method studyVirchows Archiv, 2019
- Privacy in the age of medical big dataNature Medicine, 2019
- Deep Learning for Natural Language Processing in Urology: State-of-the-Art Automated Extraction of Detailed Pathologic Prostate Cancer Data From Narratively Written Electronic Health RecordsJCO Clinical Cancer Informatics, 2018
- DeepPhe: A Natural Language Processing System for Extracting Cancer Phenotypes from Clinical RecordsCancer Research, 2017