Zero-shot information extraction from radiological reports using ChatGPT
Preprint
Abstract
Electronic health records contain an enormous amount of valuable information, but many are recorded in free text. Information extraction is the strategy to transform the sequence of characters into structured data, which can be employed for secondary analysis. However, the traditional information extraction components, such as named entity recognition and relation extraction, require annotated data to optimize the model parameters, which has become one of the major bottlenecks in building information extraction systems. With the large language models achieving good performances on various downstream NLP tasks without parameter tuning, it becomes possible to use large language models for zero-shot information extraction. In this study, we aim to explore whether the most popular large language model, ChatGPT, can extract useful information from the radiological reports. We first design the prompt template for the interested information in the CT reports. Then, we generate the prompts by combining the prompt template with the CT reports as the inputs of ChatGPT to obtain the responses. A post-processing module is developed to transform the responses into structured extraction results. We conducted the experiments with 847 CT reports collected from Peking University Cancer Hospital. The experimental results indicate that ChatGPT can achieve competitive performances for some extraction tasks compared with the baseline information extraction system, but some limitations need to be further improved.Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- A brief survey on recent advances in coreference resolutionArtificial Intelligence Review, 2023
- Fine-grained spatial information extraction in radiology as two-turn question answeringInternational Journal of Medical Informatics, 2021
- Predicting postoperative non-small cell lung cancer prognosis via long short-term relational regularizationArtificial Intelligence in Medicine, 2020
- Extracting comprehensive clinical information for breast cancer using deep learning methodsInternational Journal of Medical Informatics, 2019
- A frame semantic overview of NLP-based information extraction for cancer-related EHR notesJournal of Biomedical Informatics, 2019
- Clinical information extraction applications: A literature reviewJournal of Biomedical Informatics, 2018
- Recurrent neural networks with specialized word embeddings for health-domain named-entity recognitionJournal of Biomedical Informatics, 2017
- Natural Language Processing in OncologyJAMA Oncology, 2016
- Information extraction from multi-institutional radiology reportsArtificial Intelligence in Medicine, 2016
- Portable automatic text classification for adverse drug reaction detection via multi-corpus trainingJournal of Biomedical Informatics, 2015