Performance of Multiple Pretrained BERT Models to Automate and Accelerate Data Annotation for Large Datasets
- 29 June 2022
- journal article
- research article
- Published by Radiological Society of North America (RSNA) in Radiology: Artificial Intelligence
- Vol. 4 (4) , e220007
Abstract
Pretrained domain-specific and newer transformer models achieved high performance using small training datasets and short training times, creating a robust final model that expedited autonomous ann... Purpose To develop and evaluate domain-specific and pretrained bidirectional encoder representations from transformers (BERT) models in a transfer learning task on varying training dataset sizes to...Keywords
This publication has 18 references indexed in Scilit:
- BioBERT: a pre-trained biomedical language representation model for biomedical text miningBioinformatics, 2019
- Natural language processing to identify ureteric stones in radiology reportsJournal of Medical Imaging and Radiation Oncology, 2019
- Scaling up data curation using deep learning: An application to literature triage in genomic variation resourcesPLOS Computational Biology, 2018
- Deep Learning to Classify Radiology Free-Text ReportsRadiology, 2018
- Natural Language Processing Technologies in Radiology Research and Clinical ApplicationsRadioGraphics, 2016
- Classification of CT pulmonary angiography reports by presence, chronicity, and location of pulmonary embolism with natural language processingJournal of Biomedical Informatics, 2014
- Automated Classification of Radiology Reports to Facilitate Retrospective Study in RadiologyJournal of Digital Imaging, 2014
- Document-level classification of CT pulmonary angiography reports based on an extension of the ConText algorithmJournal of Biomedical Informatics, 2011
- Use of Natural Language Processing to Translate Clinical Information from a Database of 889,921 Chest Radiographic ReportsRadiology, 2002
- Comparing the Areas under Two or More Correlated Receiver Operating Characteristic Curves: A Nonparametric ApproachBiometrics, 1988