From Slice to Sequence: Autoregressive Tracking Transformer for Consistent 3D Lymph Node Detection in CT Scans
- 9 June 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. PP (02780062) , 1
Abstract
Lymph node (LN) assessment is an essential task in the routine radiology workflow, providing valuable insights for cancer staging and treatment planning. Identifying scatteredly-distributed and low-contrast LNs in 3D CT scans is highly challenging, even for experienced clinicians. Previous lesion and LN detection methods demonstrate the effectiveness of 2.5D approaches (i.e., using 2D backbone with multi-slice inputs), leveraging pretrained 2D model weights and showing improved accuracy as compared to separate 2D or 3D detectors. However, slice-based 2.5D detectors do not explicitly model inter-slice consistency for LN as a 3D object, requiring heuristic post-merging steps to generate final 3D LN instances, which can involve tuning a set of parameters for each dataset. In this work, we formulate 3D LN detection as a slice-by-slice tracking task along the z-axis and propose LN-Tracker, a novel LN tracking transformer, for joint end-to-end detection and 3D instance association. Built upon a DETR-based detector, LN-Tracker decouples transformer queries into distinct track and detection groups with independent matching, enabling comprehensive LN detection while maintaining trajectory consistency. A masked attention mechanism further separates learning between these query groups, and a similarity loss promotes robust interslice LN association, particularly in low-contrast scenarios. Extensive evaluation on four LN datasets shows LN-Tracker’s superior performance, with at least 2.49% gain in average sensitivity when compared to top 3D/2.5D/tracking detectors. Further validation on public lung nodule and prostate tumor detection tasks confirms the generaliz-ability of LN-Tracker as it achieves top performance on both tasks. Code is available at https://github.com/alibaba-damo-academy/LN-Tracker.Keywords
All Related Versions
Funding Information
- Zhejiang Provincial “Spearhead & Pathfinder + X” R&D Breakthrough Program (2024C03043)
- Zhejiang Provincial Natural Science Foundation of China (2024-KYI-00I-I05)
- Medical and Engineering Integration Project (XM03241807)
- Natural Science Foundation of Shanghai Municipality (25ZR1401055)
This publication has 47 references indexed in Scilit:
- MOTR: End-to-End Multiple-Object Tracking with Transformer2022
- SATr: Slice Attention with Transformer for Universal Lesion Detection2022
- Thoracic Lymph Node Segmentation in CT Imaging via Lymph Node Station Stratification and Size Encoding2022
- nnDetection: A Self-configuring Method for Medical Object Detection2021
- DeepStationing: Thoracic Lymph Node Station Parsing in CT Scans Using Anatomical Context Encoding and Key Organ Auto-Search2021
- Asymmetric 3D Context Fusion for Universal Lesion Detection2021
- End-to-End Object Detection with Transformers2020
- Lymph Node Gross Tumor Volume Detection and Segmentation via Distance-Based Gating Using 3D CT/PET Imaging in Radiotherapy2020
- MULAN: Multitask Universal Lesion Analysis Network for Joint Lesion Detection, Tagging, and Segmentation2019
- Multi-object Tracking with Neural Gating Using Bilinear LSTM2018