Combining of Multiple Deep Networks via Ensemble Generalization Loss, Based on MRI Images, for Alzheimer's Disease Classification
- 6 January 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Letters
- Vol. 27 (10709908) , 206-210
Abstract
This letter proposes a novel way of using an ensemble of multiple deep convolutional neural networks (DCNNs) for Alzheimer's disease classification, based on magnetic resonance imaging (MRI) images. To create this ensemble of DCNNs, we propose to combine the use of multiple MRI projections (as input) with that of different DCNN architectures to increase the deep ensemble diversity. In particular, to find the optimal fusion weights of the DCNN members, we designed a novel deep ensemble generalization loss, which accounts for interaction and cooperation during the optimal weight search. The optimization framework, equipped with our ensemble generalization loss, was formulated and solved using the sequential quadratic programming. Through this method, we achieved optimal DCNN weights (i.e., a high generalization performance). The experimental results showed that our proposed DCNN ensemble outperforms current deep learning-based methods: it is able to produce state-of-the-art results on the Alzheimer's disease neuroimaging initiative (ADNI) dataset.Keywords
Funding Information
- Hankuk University of Foreign Studies Research Fund
- National Research Foundation of Korea
- Korea government (NRF-2019R1A4A1029769)
This publication has 22 references indexed in Scilit:
- Ensembles of Deep Learning Architectures for the Early Diagnosis of the Alzheimer’s DiseaseInternational Journal of Neural Systems, 2016
- Alzheimer's disease diagnostics by adaptation of 3D convolutional network2016
- Canonical feature selection for joint regression and multi-class identification in Alzheimer’s disease diagnosisBrain Imaging and Behavior, 2015
- Deep sparse multi-task learning for feature selection in Alzheimer’s disease diagnosisBrain Structure and Function, 2015
- Compact Graph based Semi-Supervised Learning for Medical Diagnosis in Alzheimer’s DiseaseIEEE Signal Processing Letters, 2014
- Ensemble-based classifiersArtificial Intelligence Review, 2009
- An overlap invariant entropy measure of 3D medical image alignmentPattern Recognition, 1999
- On combining classifiersIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- Sequential Quadratic ProgrammingActa Numerica, 1995
- A globally convergent method for nonlinear programmingJournal of Optimization Theory and Applications, 1977