Leveraging Input-Level Feature Deformation With Guided-Attention for Sulcal Labeling
- 26 September 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 44 (2) , 915-926
Abstract
The identification of cortical sulci is key for understanding functional and structural development of the cortex. While large, consistent sulci (or primary/secondary sulci) receive significant attention in most studies, the exploration of smaller and more variable sulci (or putative tertiary sulci) remains relatively under-investigated. Despite its importance, automatic labeling of cortical sulci is challenging due to (1) the presence of substantial anatomical variability, (2) the relatively small size of the regions of interest (ROIs) compared to unlabeled regions, and (3) the scarcity of annotated labels. In this paper, we propose a novel end-to-end learning framework using a spherical convolutional neural network (CNN). Specifically, the proposed method learns to effectively warp geometric features in a direction that facilitates the labeling of sulci while mitigating the impact of anatomical variability. Moreover, we introduce a guided-attention mechanism that takes into account the extent of deformation induced by the learned warping. This extracts discriminative features that emphasize sulcal ROIs, while suppressing irrelevant information of unlabeled regions. In the experiments, we evaluate the proposed method on 8 sulci of the posterior medial cortex. Our method outperforms existing methods particularly in the putative tertiary sulci. The code is publicly available at https://github.com/Shape-Lab/DSPHARM-Net.Keywords
Funding Information
- National Science Foundation (2042251, BCS1558585)
- National Research Foundation of Korea (RS-2023-00251298, RS-2023-00266120, RS-2024-00333931)
- Institute for Information and Communications Technology Promotion (RS-2019-II191906, RS-2020-II201336)
- National Institutes of Health (1U54-MH-091657, R01NS057156, T32 GM140935)
This publication has 65 references indexed in Scilit:
- Unsupervised Learning of Cortical Surface Registration Using Spherical Harmonics2023
- Learning Subject-Specific Functional Parcellations from Cortical Surface Measures2022
- A Spherical Convolutional Neural Network for White Matter Structure Imaging via dMRI2021
- From Connectomic to Task-Evoked Fingerprints: Individualized Prediction of Task Contrasts from Resting-State Functional Connectivity2020
- Cortical Surface Parcellation Using Spherical Convolutional Neural Networks2019
- Spherical U-Net on Cortical Surfaces: Methods and Applications2019
- Brain Mapping Using Topology Graphs Obtained by Surface Segmentation2006
- Multisubject Non-rigid Registration of Brain MRI Using Intensity and Geometric Features2001
- High-resolution intersubject averaging and a coordinate system for the cortical surfaceHuman Brain Mapping, 1999
- Cortical Surface-Based AnalysisNeuroImage, 1999