Characterization of indeterminate breast lesions on B-mode ultrasound using automated machine learning models
- 23 October 2020
- journal article
- research article
- Published by SPIE-Intl Soc Optical Eng in Journal of Medical Imaging
- Vol. 7 (05) , 057002-12
Abstract
Purpose: While mammography has excellent sensitivity for the detection of breast lesions, its specificity is limited. Adjunct screening with ultrasound may partially alleviate this issue but also increases false positives, resulting in unnecessary biopsies. Our study investigated the use of Google AutoML Vision (Mountain View, California), a commercially available machine learning service, to both identify and characterize indeterminate breast lesions on ultrasound. Approach: B-mode images from 253 independent cases of indeterminate breast lesions scheduled for core biopsy were used for model creation and validation. The performances of two sub-models from AutoML Vision, the image classification model and object detection model, were evaluated, while also investigating training strategies to enhance model performances. Pathology from the patient’s biopsy was used as a reference standard. Results: The image classification models trained under different conditions demonstrated areas under the precision–recall curve (AUC) ranging from 0.85 to 0.96 during internal validation. Once deployed, the model with highest internal performance demonstrated a sensitivity of 100% [95% confidence interval (CI) of 73.5% to 100%], specificity of 83.3% (CI = 51.6 % to 97.9%), positive predictive value (PPV) of 85.7% (CI = 62.9 % to 95.5%), and negative predictive value (NPV) of 100% (CI non-evaluable) in an independent dataset. The object detection model demonstrated lower performance internally during development (AUC = 0.67) and during prediction in the independent dataset [sensitivity = 75 % (CI = 42.8 to 94.5), specificity = 80 % (CI = 51.9 to 95.7), PPV = 75 % (CI = 50.8 to 90.0), and NPV = 80 % (CI = 59.3 % to 91.7%)], but was able to demonstrate the location of the lesion within the image. Conclusions: Two models appear to be useful tools for identifying and classifying suspicious areas on B-mode images of indeterminate breast lesions.Keywords
This publication has 18 references indexed in Scilit:
- Ultrasound Imaging Technologies for Breast Cancer Detection and Management: A ReviewUltrasound in Medicine & Biology, 2018
- Monitoring Neoadjuvant Chemotherapy for Breast Cancer by Using Three-dimensional Subharmonic Aided Pressure Estimation and Imaging with US Contrast Agents: Preliminary ExperienceRadiology, 2017
- A deep learning framework for supporting the classification of breast lesions in ultrasound imagesPhysics in Medicine & Biology, 2017
- Automated Breast Ultrasound Lesions Detection Using Convolutional Neural NetworksIEEE Journal of Biomedical and Health Informatics, 2017
- Quantitative analysis of vascular heterogeneity in breast lesions using contrast-enhanced 3-D harmonic and subharmonic ultrasound imagingIEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 2015
- Screening Breast Ultrasound: Past, Present, and FutureAmerican Journal of Roentgenology, 2015
- The case for early detectionNature Reviews Cancer, 2003
- Comparison of the Performance of Screening Mammography, Physical Examination, and Breast US and Evaluation of Factors that Influence Them: An Analysis of 27,825 Patient EvaluationsRadiology, 2002
- Computer-Aided Diagnosis for Surgical Office-Based Breast UltrasoundArchives of Surgery, 2000
- ROC Methodology in Radiologic ImagingInvestigative Radiology, 1986