Defacing biases visual quality assessments of structural MRI
Authors:
- Céline ProvinsCPCéline Provins
- Élodie SavaryÉSÉlodie Savary
- Thomas SanchezTSThomas Sanchez
- Emeline MullierEMEmeline Mullier
- Jaime BarrancoJBJaime Barranco
- Elda Fischi-GómezEFElda Fischi-Gómez
- Yasser Alemán-GómezYAYasser Alemán-Gómez
- Jonas RichiardiJRJonas Richiardi
- Russell A. PoldrackRPRussell A. Poldrack
- Patric HagmannPHPatric Hagmann
- Oscar EstebanOEOscar Esteban
Preprint
Abstract
A critical step before data-sharing of human neuroimaging is removing facial features to protect individuals’ privacy. However, not only does this process redact identifiable information about individuals, but it also removes non-identifiable information. This introduces undesired variability into downstream analysis and interpretation. This registered report investigated the degree to which the so-called defacing altered the quality assessment of T1-weighted images of the human brain from the openly available “IXI dataset”. The effect of defacing on manual quality assessment was investigated on a single-site subset of the dataset (N=185). By comparing two linear mixed-effects models, we determined that four trained human raters’ perception of quality was significantly influenced by defacing by modeling their ratings on the same set of images in two conditions: “nondefaced” (i.e., preserving facial features) and “defaced”. In addition, we investigated these biases on automated quality assessments by applying repeated-measures, multivariate ANOVA (rm-MANOVA) on the image quality metrics extracted with MRIQC on the full IXI dataset (N=581; three acquisition sites). This study found that defacing altered the quality assessments by humans and showed that MRIQC ’s quality metrics were mostly insensitive to defacing.Keywords
This publication has 46 references indexed in Scilit:
- Reproducibility and repeatability of magnetic resonance imaging in dementiaPhysica Medica, 2022
- Systematic evaluation of the impact of defacing on quality and volumetric assessments on T1-weighted MR-imagesJournal Of Neuroradiology, 2022
- Facing privacy in neuroimaging: removing facial features degrades performance of image analysis methodsEuropean Radiology, 2019
- Improving Out-of-Sample Prediction of Quality of MRIQC2018
- Mindcontrol: A web application for brain segmentation quality controlNeuroImage, 2018
- Connectome sensitivity or specificity: which is more important?NeuroImage, 2016
- Subtle in-scanner motion biases automated measurement of brain anatomy from in vivo MRIHuman Brain Mapping, 2016
- Human Connectome Project informatics: Quality control, database services, and data visualizationNeuroImage, 2013
- Spurious but systematic correlations in functional connectivity MRI networks arise from subject motionNeuroImage, 2012
- Automatic quality assessment in structural brain magnetic resonance imagingMagnetic Resonance in Medicine, 2009