From Slices to Sequences: Autoregressive Tracking Transformer for Cohesive and Consistent 3D Lymph Node Detection in CT Scans
Authors:
Preprint
Abstract
Lymph node (LN) assessment is an essential task in the routine radiology workflow, providing valuable insights for cancer staging, treatment planning and beyond. Identifying scatteredly-distributed and low-contrast LNs in 3D CT scans is highly challenging, even for experienced clinicians. Previous lesion and LN detection methods demonstrate effectiveness of 2.5D approaches (i.e, using 2D network with multi-slice inputs), leveraging pretrained 2D model weights and showing improved accuracy as compared to separate 2D or 3D detectors. However, slice-based 2.5D detectors do not explicitly model inter-slice consistency for LN as a 3D object, requiring heuristic post-merging steps to generate final 3D LN instances, which can involve tuning a set of parameters for each dataset. In this work, we formulate 3D LN detection as a tracking task and propose LN-Tracker, a novel LN tracking transformer, for joint end-to-end detection and 3D instance association. Built upon DETR-based detector, LN-Tracker decouples transformer decoder's query into the track and detection groups, where the track query autoregressively follows previously tracked LN instances along the z-axis of a CT scan. We design a new transformer decoder with masked attention module to align track query's content to the context of current slice, meanwhile preserving detection query's high accuracy in current slice. An inter-slice similarity loss is introduced to encourage cohesive LN association between slices. Extensive evaluation on four lymph node datasets shows LN-Tracker's superior performance, with at least 2.7% gain in average sensitivity when compared to other top 3D/2.5D detectors. Further validation on public lung nodule and prostate tumor detection tasks confirms the generalizability of LN-Tracker as it achieves top performance on both tasks.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Deep-learning based detection of vessel occlusions on CT-angiography in patients with suspected acute ischemic strokeNature Communications, 2023
- Advancing 3D medical image analysis with variable dimension transform based supervised 3D pre-trainingNeurocomputing, 2023
- Anatomy-Aware Lymph Node Detection in Chest CT Using Implicit Station Stratification2023
- Towards automated organs at risk and target volumes contouring: Defining precision radiation therapy in the modern eraJournal of the National Cancer Center, 2022
- MommiNet-v2: Mammographic multi-view mass identification networksMedical Image Analysis, 2021
- DeepStationing: Thoracic Lymph Node Station Parsing in CT Scans Using Anatomical Context Encoding and Key Organ Auto-Search2021
- FairMOT: On the Fairness of Detection and Re-identification in Multiple Object TrackingInternational Journal of Computer Vision, 2021
- Quality control and whole-gland, zonal and lesion annotations for the PROSTATEx challenge public datasetEuropean Journal of Radiology, 2021
- Melanoma lesion detection and segmentation using deep region based convolutional neural network and fuzzy C-means clusteringInternational Journal of Medical Informatics, 2019
- Semantic segmentation and detection of mediastinal lymph nodes and anatomical structures in CT data for lung cancer stagingInternational Journal of Computer Assisted Radiology and Surgery, 2019