DiffusionDet: Diffusion Model for Object Detection
Authors:
Top Cited Papers
- 1 October 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 19773-19786
Abstract
We propose DiffusionDet, a new framework that formulates object detection as a denoising diffusion process from noisy boxes to object boxes. During the training stage, object boxes diffuse from ground-truth boxes to random distribution, and the model learns to reverse this noising process. In inference, the model refines a set of randomly generated boxes to the output results in a progressive way. Our work possesses an appealing property of flexibility, which enables the dynamic number of boxes and iterative evaluation. The extensive experiments on the standard benchmarks show that DiffusionDet achieves favorable performance compared to previous well-established detectors. For example, DiffusionDet achieves 5.3 AP and 4.8 AP gains when evaluated with more boxes and iteration steps, under a zero-shot transfer setting from COCO to CrowdHuman. Our code is available at https://github.com/ShoufaChen/DiffusionDet.Keywords
All Related Versions
This publication has 55 references indexed in Scilit:
- SILVR: Guided Diffusion for Molecule Generation2023
- In Defense of Online Models for Video Instance Segmentation2022
- End-to-End Object Detection with Transformers2020
- Empirical Risk Minimization2017
- SSD: Single Shot MultiBox Detector2016
- Hollywood in Homes: Crowdsourcing Data Collection for Activity Understanding2016
- Visual Relationship Detection with Language Priors2016
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- ImageNet: A large-scale hierarchical image database2009