Multi-modal Variational Autoencoders for normative modelling across multiple imaging modalities
Preprint
Abstract
One of the challenges of studying common neurological disorders is disease heterogeneity including differences in causes, neuroimaging characteristics, comorbidities, or genetic variation. Normative modelling has become a popular method for studying such cohorts where the 'normal' behaviour of a physiological system is modelled and can be used at subject level to detect deviations relating to disease pathology. For many heterogeneous diseases, we expect to observe abnormalities across a range of neuroimaging and biological variables. However, thus far, normative models have largely been developed for studying a single imaging modality. We aim to develop a multi-modal normative modelling framework where abnormality is aggregated across variables of multiple modalities and is better able to detect deviations than uni-modal baselines. We propose two multi-modal VAE normative models to detect subject level deviations across T1 and DTI data. Our proposed models were better able to detect diseased individuals, capture disease severity, and correlate with patient cognition than baseline approaches. We also propose a multivariate latent deviation metric, measuring deviations from the joint latent space, which outperformed feature-based metrics.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Generalized Product-of-Experts for Learning Multimodal Representations in Noisy Environments2022
- Using normative modelling to detect disease progression in mild cognitive impairment and Alzheimer’s disease in a cross-sectional multi-cohort studyScientific Reports, 2021
- Harmonization of large MRI datasets for the analysis of brain imaging patterns throughout the lifespanNeuroImage, 2020
- Image processing and Quality Control for the first 10,000 brain imaging datasets from UK BiobankNeuroImage, 2018
- Understanding Heterogeneity in Clinical Cohorts Using Normative Models: Beyond Case-Control StudiesBiological Psychiatry, 2016
- UK Biobank: An Open Access Resource for Identifying the Causes of a Wide Range of Complex Diseases of Middle and Old AgePLOS Medicine, 2015
- Alzheimer's Disease Neuroimaging Initiative (ADNI)Neurology, 2010