Exploring viability of Test-Time Training: Application to 3D segmentation in Multiple Sclerosis
Authors:
- 25 June 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 557-562
Abstract
Test-Time Training (TTT) is an unsupervised domain adaptation technique employing a self-supervised task performed by an attached branch model. While justification of key design choices are often neglected in the literature, we explore the viability of TTT in a real-case scenario and conduct an extensive evaluation of key hyperparameters in TTT, including the choice and the placement of the auxiliary task, the type of normalization layer, and the model parameters to adapt. We carry out this study in Multiple Sclerosis (MS) diagnosis relying on focal lesions visible in conventional MRI. Manual lesion segmentation based on automated methods face significant challenges in clinical integration due to MRI domain shifts, i.e. discrepancies between training and deployment data, notably due to different acquisition settings. We apply TTT to each patient individually, offering an effective strategy to mitigate domain shift without the need of additional annotated data or data from other patients. We ground our experiments on real-world distribution shifts using three distinct MS datasets. Finally, we propose general guidelines to apply TTT in practice. Code available at github.com/Gerin-Benoit/ttt-for-multi-sclerosis.Keywords
Funding Information
- Service Public de Wallonie
This publication has 22 references indexed in Scilit:
- Test-Time Adaptation with Shape Moments for Image Segmentation2022
- DeepLesionBrain: Towards a broader deep-learning generalization for multiple sclerosis lesion segmentationMedical Image Analysis, 2022
- Test-time adaptable neural networks for robust medical image segmentationMedical Image Analysis, 2021
- A contrast-adaptive method for simultaneous whole-brain and lesion segmentation in multiple sclerosisNeuroImage, 2021
- Domain Adaptive Relational Reasoning for 3D Multi-organ Segmentation2020
- Test-Time Unsupervised Domain Adaptation2020
- Multiple sclerosis cortical and WM lesion segmentation at 3T MRI: a deep learning method based on FLAIR and MP2RAGENeuroImage: Clinical, 2020
- One-shot domain adaptation in multiple sclerosis lesion segmentation using convolutional neural networksNeuroImage: Clinical, 2019
- Deep learning for segmentation of brain tumors: Impact of cross‐institutional training and testingMedical Physics, 2018
- MRI FLAIR lesion segmentation in multiple sclerosis: Does automated segmentation hold up with manual annotation?NeuroImage: Clinical, 2017