Performance Comparison of Individual and Ensemble CNN Models for the Classification of Brain 18F-FDG-PET Scans
- 28 October 2019
- journal article
- research article
- Published by Springer Nature in Journal of Digital Imaging
- Vol. 33 (2) , 447-455
Abstract
The high-background glucose metabolism of normal gray matter on [18F]-fluoro-2-D-deoxyglucose (FDG) positron emission tomography (PET) of the brain results in a low signal-to-background ratio, potentially increasing the possibility of missing important findings in patients with intracranial malignancies. To explore the strategy of using a deep learning classifier to aid in distinguishing normal versus abnormal findings on PET brain images, this study evaluated the performance of a two-dimensional convolutional neural network (2D-CNN) to classify FDG PET brain scans as normal (N) or abnormal (A). Methods: Two hundred eighty-nine brain FDG-PET scans (N; n = 150, A; n = 139) resulting in a total of 68,260 images were included. Nine individual 2D-CNN models with three different window settings for axial, coronal, and sagittal axes were trained and validated. The performance of these individual and ensemble models was evaluated and compared using a test dataset. Odds ratio, Akaike’s information criterion (AIC), and area under curve (AUC) on receiver-operative-characteristic curve, accuracy, and standard deviation (SD) were calculated. Results: An optimal window setting to classify normal and abnormal scans was different for each axis of the individual models. An ensembled model using different axes with an optimized window setting (window-triad) showed better performance than ensembled models using the same axis and different windows settings (axis-triad). Increase in odds ratio and decrease in SD were observed in both axis-triad and window-triad models compared with individual models, whereas improvements of AUC and AIC were seen in window-triad models. An overall model averaging the probabilities of all individual models showed the best accuracy of 82.0%. Conclusions: Data ensemble using different window settings and axes was effective to improve 2D-CNN performance parameters for the classification of brain FDG-PET scans. If prospectively validated with a larger cohort of patients, similar models could provide decision support in a clinical setting.Keywords
This publication has 22 references indexed in Scilit:
- A survey on deep learning in medical image analysisMedical Image Analysis, 2017
- Deep Learning at Chest Radiography: Automated Classification of Pulmonary Tuberculosis by Using Convolutional Neural NetworksRadiology, 2017
- Rotational data augmentation for electroencephalographic data2017
- Interpretive Error in RadiologyAmerican Journal of Roentgenology, 2017
- Dermatologist-level classification of skin cancer with deep neural networksNature, 2017
- How We Read Oncologic FDG PET/CTCancer Imaging, 2016
- An Ensemble of 2D Convolutional Neural Networks for Tumor Segmentation2015
- Current radiologist workload and the shortages in Japan: how many full-time radiologists are required?Japanese Journal of Radiology, 2015
- A study on several Machine-learning methods for classification of Malignant and benign clustered microcalcificationsIEEE Transactions on Medical Imaging, 2005
- Positron emission tomography imaging of brain tumorsNeuroimaging Clinics Of North America, 2002