Diagnosis of thyroid disease using deep convolutional neural network models applied to thyroid scintigraphy images: a multicenter study
Open Access
- 11 August 2023
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Endocrinology
- Vol. 14, 1224191
Abstract
Objectives: The aim of this study was to improve the diagnostic performance of nuclear medicine physicians using a deep convolutional neural network (DCNN) model and validate the results with two multicenter datasets for thyroid disease by analyzing clinical single-photon emission computed tomography (SPECT) image data.Methods: In this multicenter retrospective study, 3194 SPECT thyroid images were collected for model training (n=2067), internal validation (n=514) and external validation (n=613). First, four pretrained DCNN models (AlexNet, ShuffleNetV2, MobileNetV3 and ResNet-34) for were tested multiple medical image classification of thyroid disease types (i.e., Graves’ disease, subacute thyroiditis, thyroid tumor and normal thyroid). The best performing model was then subjected to fivefold cross-validation to further assess its performance, and the diagnostic performance of this model was compared with that of junior and senior nuclear medicine physicians. Finally, class-specific attentional regions were visualized with attention heatmaps using gradient-weighted class activation mapping.Results: Each of the four pretrained neural networks attained an overall accuracy of more than 0.85 for the classification of SPECT thyroid images. The improved ResNet-34 model performed best, with an accuracy of 0.944. For the internal validation set, the ResNet-34 model showed higher accuracy (p < 0.001) when compared to that of the senior nuclear medicine physician, with an improvement of nearly 10%. Our model achieved an overall accuracy of 0.931 for the external dataset, a significantly higher accuracy than that of the senior physician (0.931 vs. 0.868, p < 0.001).Conclusion: The DCNN-based model performed well in terms of diagnosing thyroid scintillation images. The DCNN model showed higher sensitivity and greater specificity in identifying Graves’ disease, subacute thyroiditis, and thyroid tumors compared to those of nuclear medicine physicians, illustrating the feasibility of deep learning models to improve the diagnostic efficiency for assisting clinicians.Keywords
This publication has 36 references indexed in Scilit:
- Diagnosis of thyroid cancer using deep convolutional neural network models applied to sonographic images: a retrospective, multicohort, diagnostic studyThe Lancet Oncology, 2019
- Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologistsAnnals of Oncology, 2018
- The Impact of Multi-Optimizers and Data Augmentation on TensorFlow Convolutional Neural Network Performance2018
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- Can we open the black box of AI?Nature, 2016
- Deep Residual Learning for Image Recognition2016
- Hypothyroidism in WomenNursing for Women's Health, 2016
- Reverse Engineering the Neural Networks for Rule Extraction in Classification ProblemsNeural Processing Letters, 2011
- The continuing importance of thyroid scintigraphy in the era of high-resolution ultrasoundEuropean Journal of Nuclear Medicine and Molecular Imaging, 2002
- The Cross-Entropy Method for Combinatorial and Continuous OptimizationMethodology and Computing in Applied Probability, 1999