ARE-PaLED: Augmented Reality-Enhanced Patch-Level Explainable Deep Learning System for Alzheimer’s Disease Diagnosis from 3D Brain sMRI
Open Access
Abstract
Structural magnetic resonance imaging (sMRI) is a vital tool for diagnosing neurological brain diseases. However, sMRI scans often show significant structural changes only in limited brain regions due to localised atrophy, making the identification of discriminative features a key challenge. Importantly, the human brain exhibits inherent bilateral symmetry, and deviations from this symmetry—such as asymmetric atrophy—are strong indicators of early Alzheimer’s disease (AD). Patch-based methods help capture local brain changes for early AD diagnosis, but they often struggle with fixed-size limitations, potentially missing subtle asymmetries or broader contextual cues. To address these limitations, we propose a novel augmented reality (AR)-enhanced patch-level explainable deep learning (ARE-PaLED) system. It includes an adaptive multi-scale patch extraction network (AMPEN) to adjust patch sizes based on anatomical characteristics and spatial context, as well as an informative patch selection algorithm (IPSA) to identify discriminative patches, including those reflecting asymmetry patterns associated with AD; additionally, an AR module is proposed for future immersive explainability, complementing the patch-level interpretation framework. Evaluated on 1862 subjects from the ADNI and AIBL datasets, the framework achieved an accuracy of 92.5% (AD vs. NC) and 85.9% (AD vs. MCI). The proposed ARE-PaLED demonstrates potential as an interpretable and immersive diagnostic aid for sMRI-based AD diagnosis, supporting the interpretation of model predictions for AD diagnosis.Keywords
This publication has 62 references indexed in Scilit:
- Leveraging CapsNet for enhanced classification of 3D MRI images for Alzheimer’s diagnosisBiomedical Signal Processing and Control, 2025
- Patch-based interpretable deep learning framework for Alzheimer’s disease diagnosis using multimodal dataBiomedical Signal Processing and Control, 2024
- 2023 Alzheimer's disease facts and figuresAlzheimer's & Dementia, 2023
- GA-MADRID: design and validation of a machine learning tool for the diagnosis of Alzheimer’s disease and frontotemporal dementia using genetic algorithmsMedical & Biological Engineering & Computing, 2022
- AlzVNet: A volumetric convolutional neural network for multiclass classification of Alzheimer’s disease through multiple neuroimaging computational approachesBiomedical Signal Processing and Control, 2022
- Texture descriptors and voxels for the early diagnosis of Alzheimer’s diseaseArtificial Intelligence in Medicine, 2019
- Applications of Virtual and Augmented Reality in Biomedical ImagingJournal of Medical Systems, 2019
- Hierarchical Ensemble of Multi-level Classifiers for Diagnosis of Alzheimer’s Disease2012
- In Vivo Mapping of Gray Matter Loss with Voxel-Based Morphometry in Mild Alzheimer's DiseaseNeuroImage, 2001
- Voxel-Based Morphometry—The MethodsNeuroImage, 2000