Organ-DETR: Organ Detection via Transformers
Open Access
- 19 February 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 44 (6) , 2657-2671
Abstract
Query-based Transformers have been yielding impressive performance in object localization and detection tasks. However, their application to organ detection in 3D medical imaging data has been relatively unexplored. This study introduces Organ-DETR, featuring two innovative modules, MultiScale Attention (MSA) and Dense Query Matching (DQM), designed to enhance the performance of Detection Transformers (DETRs) for 3D organ detection. MSA is a novel top-down representation learning approach for efficiently encoding Computed Tomography (CT) features. This architecture employs a multiscale attention mechanism, utilizing both dual self-attention and cross-scale attention mechanisms to extract intra- and inter-scale spatial interactions in the attention mechanism. Organ-DETR also introduces DQM, an approach for one-to-many matching that tackles the label assignment difficulties in organ detection. DQM increases positive queries to enhance both recall scores and training efficiency without the need for additional learnable parameters. Extensive results on five 3D CT datasets indicate that the proposed Organ-DETR outperforms comparable techniques by achieving a remarkable improvement of +10.6 mAP COCO. The project and code are available at https://github.com/ai-med/ OrganDETR.Keywords
Funding Information
- German Research Foundation
This publication has 58 references indexed in Scilit:
- MedYOLO: A Medical Image Object Detection FrameworkJournal of Imaging Informatics in Medicine, 2024
- Towards Data-Efficient Detection Transformers2022
- Relationformer: A Unified Framework for Image-to-Graph Generation2022
- nnDetection: A Self-configuring Method for Medical Object Detection2021
- Lung Nodule Detection based on Faster R-CNN FrameworkComputer Methods and Programs in Biomedicine, 2021
- Probabilistic Anchor Assignment with IoU Prediction for Object Detection2020
- End-to-End Object Detection with Transformers2020
- Semantic segmentation and detection of mediastinal lymph nodes and anatomical structures in CT data for lung cancer stagingInternational Journal of Computer Assisted Radiology and Surgery, 2019
- Automatic localization of solid organs on 3D CT images by a collaborative majority voting decision based on ensemble learningComputerized Medical Imaging and Graphics, 2012
- The Hungarian method for the assignment problemNaval Research Logistics Quarterly, 1955