Bayesian Transformers and Higher-Order Graph Matching for Cell Tracking in Serial Tissue Sections
- 19 September 2025
- book chapter
- Published by Springer Nature
- Vol. 15971, 87-97
Abstract
Reliable 3D reconstruction of tissue architecture from sequential 2D multiplex images is challenging due to the noise and distortions introduced by ultrathin (50 nm) slicing and complex alignment procedures. Conventional cell tracking methods often fail under such conditions, resulting in inaccurate linkage of cells across sections. To bridge this gap, we propose a Bayesian Transformer framework that incorporates uncertainty-aware feature embeddings and higher-order graph matching with belief propagation. By tracking cells across consecutive sections, our method facilitates the 3D reconstruction of volumetric tissue organization, even in highly noise-prone scenarios. The methodology begins with a standard segmentation step, followed by feature extraction that computes morphological, shape, and texture descriptors, as well as deep CNN embeddings. These rich, uncertainty-sensitive representations reduce errors caused by both registration artifacts and morphological variability. We validate the effectiveness of the proposed approach on a private multiplex dataset of fixed tissue sections and further demonstrate its generalizability on public time-lapse microscopy videos, showcasing adaptability to diverse datasets. Experimental comparisons reveal that our method outperforms baseline tracking techniques, achieving higher accuracy and more consistent cell linkages across multiple serial sections. The code used in this research with sample dataset are publicly available at https://github.com/NabaviLab/bayesian-transformer-cell-trackingKeywords
This publication has 34 references indexed in Scilit:
- TRACKASTRA: Transformer-Based Cell Tracking for Live-Cell Microscopy2024
- SynCellFactory: Generative Data Augmentation for Cell Tracking2024
- Graph Neural Network for Cell Tracking in Microscopy Videos2022
- In Toto Imaging and Reconstruction of Post-Implantation Mouse Development at the Single-Cell LevelCell, 2018
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Feature Correspondence Via Graph Matching: Models and Global Optimization2008
- Co-registration of Histological, Optical and MR Data of the Human Brain2002
- A comparative study of texture measures with classification based on featured distributionsPattern Recognition, 1996
- Elliptic Fourier features of a closed contourComputer Graphics and Image Processing, 1982
- Biological shape and visual science (part I)Journal of Theoretical Biology, 1973