An Intelligent Breast Ultrasound System for Diagnosis and 3D Visualization
Open Access
- 6 July 2022
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 11 (14) , 2116
Abstract
Background: Ultrasonography is the main examination method for breast diseases. Ultrasound imaging is currently relied upon by doctors to form statements of characteristics and locations of lesions, which severely limits the completeness and effectiveness of ultrasound image information. Moreover, analyzing ultrasonography requires experienced ultrasound doctors, which are not common in hospitals. Thus, this work proposes a 3D-based breast ultrasound system, which can automatically diagnose ultrasound images of the breasts and generate a representative 3D breast lesion model through typical ultrasonography. Methods: In this system, we use a weighted ensemble method to combine three different neural networks and explore different combinations of the neural networks. On this basis, a breast locator was designed to measure and transform the spatial position of lesions. The breast ultrasound software generates a 3D visualization report through the selection and geometric transformation of the nodular model. Results: The ensemble neural network improved in all metrics compared with the classical neural network (DenseNet, AlexNet, GoogLeNet, etc.). It proved that the ensemble neural network proposed in this work can be used for intelligent diagnosis of breast ultrasound images. For 3D visualization, magnetic resonance imaging (MRI) scans were performed to achieve their 3D reconstructions. By comparing two types of visualized results (MRI and our 3D model), we determined that models generated by the 3D-based breast ultrasound system have similar nodule characteristics and spatial relationships with the MRI. Conclusions: In summary, this system implements automatic diagnosis of ultrasound images and presents lesions through 3D models, which can obtain complete and accurate ultrasound image information. Thus, it has clinical potential.Keywords
Funding Information
- National Natural Science Foundation of China (62176268, 2020-JKCS-008, WKJ-ZJ-2112, BK19BF004)
- non-profit Central Research Institute Fund of Chinese Academy of Medical Sciences (62176268, 2020-JKCS-008, WKJ-ZJ-2112, BK19BF004)
- Major Science and Technology Project of Zhejiang Province Health Commission (62176268, 2020-JKCS-008, WKJ-ZJ-2112, BK19BF004)
- Scientific and Technological Innovation Foundation of Shunde Graduate School of USTB (62176268, 2020-JKCS-008, WKJ-ZJ-2112, BK19BF004)
This publication has 21 references indexed in Scilit:
- Early clinical response and long-term radiographic progression in recent-onset rheumatoid arthritis: Clinical remission within six months remains the treatment targetJoint Bone Spine, 2019
- CT‐guided biopsy of breast lesions: When should it be considered?The Breast Journal, 2019
- Breast cancer research and treatment reconstruction of unilateral breast structure using three-dimensional ultrasound imaging to assess breast neoplasmBreast Cancer Research and Treatment, 2019
- Learning Transferable Architectures for Scalable Image Recognition2018
- Densely Connected Convolutional Networks2017
- Aggregated Residual Transformations for Deep Neural Networks2017
- Deep Residual Learning for Image Recognition2016
- Multiplanar Reconstructions of 3D Automated Breast Ultrasound Improve Lesion Differentiation by RadiologistsAcademic Radiology, 2015
- Fluorescence-guided surgery with live molecular navigation — a new cutting edgeNature Reviews Cancer, 2013
- Automated breast cancer detection and classification using ultrasound images: A surveyPattern Recognition, 2010