Bounding Box-Guided Diffusion for Synthesizing Industrial Images and Segmentation Maps
Open Access
- 16 March 2026
- journal article
- research article
- Published by MDPI AG in Journal of Imaging
- Vol. 12 (3) , 132
Abstract
Synthetic dataset generation in Computer Vision, particularly for industrial applications, is still underexplored. Industrial defect segmentation, for instance, requires highly accurate labels, yet acquiring such data is costly and time-consuming. To address this challenge, we propose a novel diffusion-based pipeline for generating high-fidelity industrial datasets with minimal supervision. Our approach conditions the diffusion model on enriched bounding-box representations to produce precise segmentation masks, ensuring realistic and accurately localized defect synthesis. Compared to existing layout-conditioned generative methods, our approach improves defect consistency and spatial accuracy. We introduce two quantitative metrics to evaluate the effectiveness of our method and assess its impact on a downstream segmentation task trained on real and synthetic data. Our results demonstrate that diffusion-based synthesis can bridge the gap between artificial and real-world industrial data, fostering more reliable and cost-efficient segmentation models.Keywords
All Related Versions
Funding Information
- Covision Lab Scarl
- Schaeffler Automotive Buehl GmbH
- Open Access Publishing Fund of the Free University of Bozen-Bolzano
This publication has 36 references indexed in Scilit:
- Adding Conditional Control to Text-to-Image Diffusion Models2023
- GLIGEN: Open-Set Grounded Text-to-Image Generation2023
- Semi-Perspective Decoupled Heatmaps for 3D Robot Pose Estimation From Depth MapsIEEE Robotics and Automation Letters, 2022
- Interactive Image Synthesis with Panoptic Layout Generation2022
- Mixed supervision for surface-defect detection: From weakly to fully supervised learningComputers in Industry, 2021
- Learning Layout and Style Reconfigurable GANs for Controllable Image SynthesisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2021
- A Style-Based Generator Architecture for Generative Adversarial Networks2019
- Image Generation From Layout2019
- Segmentation-based deep-learning approach for surface-defect detectionJournal of Intelligent Manufacturing, 2019
- Surface Defect Saliency of Magnetic Tile2018