Proactive Construction of an Annotated Imaging Database for Artificial Intelligence Training
Open Access
- 9 November 2020
- journal article
- research article
- Published by Springer Nature in Journal of Digital Imaging
- Vol. 34 (1) , 105-115
Abstract
Artificial intelligence (AI) holds much promise for enabling highly desired imaging diagnostics improvements. One of the most limiting bottlenecks for the development of useful clinical-grade AI models is the lack of training data. One aspect is the large amount of cases needed and another is the necessity of high-quality ground truth annotation. The aim of the project was to establish and describe the construction of a database with substantial amounts of detail-annotated oncology imaging data from pathology and radiology. A specific objective was to be proactive, that is, to support undefined subsequent AI training across a wide range of tasks, such as detection, quantification, segmentation, and classification, which puts particular focus on the quality and generality of the annotations. The main outcome of this project was the database as such, with a collection of labeled image data from breast, ovary, skin, colon, skeleton, and liver. In addition, this effort also served as an exploration of best practices for further scalability of high-quality image collections, and a main contribution of the study was generic lessons learned regarding how to successfully organize efforts to construct medical imaging databases for AI training, summarized as eight guiding principles covering team, process, and execution aspects.Keywords
Funding Information
- Linköping University
This publication has 9 references indexed in Scilit:
- TissueWand, a Rapid Histopathology Annotation ToolJournal of Pathology Informatics, 2020
- MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reportsScientific Data, 2019
- Annotations, Ontologies, and Whole Slide Images – Development of an Annotated Ontology-Driven Whole Slide Image Library of Normal and Abnormal Human TissueJournal of Pathology Informatics, 2019
- A survey on deep learning in medical image analysisMedical Image Analysis, 2017
- ChestX-Ray8: Hospital-Scale Chest X-Ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases2017
- Development of a Reference Image Collection Library for Histopathology Image Processing, Analysis and Decision Support Systems ResearchJournal of Digital Imaging, 2017
- Resources Required for Semi-Automatic Volumetric Measurements in Metastatic Chordoma: Is Potentially Improved Tumor Burden Assessment Worth the Time Burden?Journal of Digital Imaging, 2015
- Structured labeling for facilitating concept evolution in machine learning2014
- PhysioBank, PhysioToolkit, and PhysioNetCirculation, 2000