Interpretable diagnosis of breast lesions in ultrasound imaging using deep multi-stage reasoning
- 24 October 2024
- journal article
- research article
- Published by IOP Publishing in Physics in Medicine & Biology
- Vol. 69 (21) , 215025
Abstract
Objective. Ultrasound is the primary screening test for breast cancer. However, providing an interpretable auxiliary diagnosis of breast lesions is a challenging task. This study aims to develop an interpretable auxiliary diagnostic method to enhance usability in human-machine collaborative diagnosis. Approach. To address this issue, this study proposes the deep multi-stage reasoning method (DMSRM), which provides individual and overall breast imaging-reporting and data system (BI-RADS) assessment categories for breast lesions. In the first stage of the DMSRM, the individual BI-RADS assessment network (IBRANet) is designed to capture lesion features from breast ultrasound images. IBRANet performs individual BI-RADS assessments of breast lesions using ultrasound images, focusing on specific features such as margin, contour, echogenicity, calcification, and vascularity. In the second stage, evidence reasoning (ER) is employed to achieve uncertain information fusion and reach an overall BI-RADS assessment of the breast lesions. Main results. To evaluate the performance of DMSRM at each stage, two test sets are utilized: the first for individual BI-RADS assessment, containing 4322 ultrasound images; the second for overall BI-RADS assessment, containing 175 sets of ultrasound image pairs. In the individual BI-RADS assessment of margin, contour, echogenicity, calcification, and vascularity, IBRANet achieves accuracies of 0.9491, 0.9466, 0.9293, 0.9234, and 0.9625, respectively. In the overall BI-RADS assessment of lesions, the ER achieves an accuracy of 0.8502. Compared to independent diagnosis, the human-machine collaborative diagnosis results of three radiologists show increases in positive predictive value by 0.0158, 0.0427, and 0.0401, in sensitivity by 0.0400, 0.0600 and 0.0434, and in area under the curve by 0.0344, 0.0468, and 0.0255. Significance. This study proposes a DMSRM that enhances the transparency of the diagnostic reasoning process. Results indicate that DMSRM exhibits robust BI-RADS assessment capabilities and provides an interpretable reasoning process that better suits clinical needs.Keywords
Funding Information
- Joint Fund for Medical Artificial Intelligence of the First Affiliated Hospital of University of Science and Technology of China (MAI2022C005)
This publication has 40 references indexed in Scilit:
- Attention guided grad-CAM : an improved explainable artificial intelligence model for infrared breast cancer detectionMultimedia Tools and Applications, 2023
- HiFuse: Hierarchical multi-scale feature fusion network for medical image classificationBiomedical Signal Processing and Control, 2023
- A novel image-to-knowledge inference approach for automatically diagnosing tumorsExpert Systems with Applications, 2023
- Cross-domain decision making based on TrAdaBoost for diagnosis of breast lesionsArtificial Intelligence Review, 2022
- Fully automatic classification of automated breast ultrasound (ABUS) imaging according to BI-RADS using a deep convolutional neural networkEuropean Radiology, 2022
- Multiple criteria decision making with reliability of assessmentAnnals of Operations Research, 2021
- Breast cancer, screening and diagnostic tools: All you need to knowCritical Reviews in Oncology/Hematology, 2021
- Data-driven group decision making for diagnosis of thyroid noduleScience China Information Sciences, 2019
- Evidential reasoning rule for evidence combinationArtificial Intelligence, 2013
- A Review of Breast UltrasoundJournal of Mammary Gland Biology and Neoplasia, 2006