Toward Data-Model-Agnostic Autonomous Machine-Generated Data Labeling and Annotation Platform: COVID-19 Autoannotation Use Case
- 28 July 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Engineering Management
- Vol. 70 (8) , 2695-2706
Abstract
Quick, early, and precise detection is important for diagnosis to control the spread of COVID-19 infection. Artificial Intelligence (AI) technology could certainly be used as a modulating tool to ease the detection, and help with the preventive steps further. Convolutional neural networks (CNNs) have achieved state-of-the-art performance in many visual recognition tasks. Nevertheless, most of these state-of-the-art networks highly rely on the availability of a high amount of labeled data, being an essential step in supervised machine learning tasks. Conventionally, this manual, mundane, and time-consuming process of annotating images is done by humans. Learning to localize or detect COVID-19 infection masks in our specific case study typically requires the collection of CT scan data that has been labeled with bounding boxes or similar annotations, which generally is limited. A technique that could perform such learning with much less annotations, and transfer the learned proposals that are algorithm-driven to generate more synthetic annotated samples would be helpful & quite valuable. We present such a technique inspired by weakly trained mask region based convolutional neural networks (R-CNN) architecture for localization, in which the number of images with their pixel-level masks can be a small proportion of the total dataset, and then further improvise CNNs by inversely generating dense annotations on-the-go using an algorithmic-based computational approach. We focus on alleviating the bottleneck associated with deep learning models needing annotated data for training in an intuitive reverse engineering fashion through this work. Our proposed solution can certainly provide the prospect of automated labeling on-the-fly, thereby reducing much of the manual work. As a result, one can quickly train a precise COVID-19 infection detector with the leverage of autonomous frame-by-frame machine generated annotations. The model achieved mean precision accuracy (%) of 0.99, 0.931, and 0.8 for train, validation, and test set, respectively. The results demonstrate that the proposed method can be adopted in a clinical setting for assisting radiologists, and also our fully autonomous approach can be generalized to any detection/recognition tasks at ease.Keywords
This publication has 47 references indexed in Scilit:
- Using Artificial Intelligence to Detect COVID-19 and Community-acquired Pneumonia Based on Pulmonary CT: Evaluation of the Diagnostic AccuracyRadiology, 2020
- Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCREurosurveillance, 2020
- Face Detection Based on YOLOv32019
- Recent progress in semantic image segmentationArtificial Intelligence Review, 2018
- Mask R-CNN2017
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization2017
- Assessing semantic information in convolutional neural network representations of images via image annotation2016
- Learning Structured Inference Neural Networks with Label Relations2016
- Deep neural network based image annotationPattern Recognition Letters, 2015
- Automatic Image Annotation using Deep Learning Representations2015