CC-Diff++: Spatially Controllable Text-to-Image Synthesis for Remote Sensing With Enhanced Contextual Coherence
- 6 October 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-16
Abstract
Generating visually realistic remote sensing (RS) images requires maintaining semantic coherence between objects and their surrounding environments. However, existing image synthesis methods prioritize foreground controllability while oversimplifying backgrounds into plain or generic textures. This oversight neglects the crucial interaction between foreground and background elements, resulting in semantic inconsistencies in RS scenarios. To address this challenge, we propose CC-Diff++, a Diffusion Model-based approach for spatially controllable RS image synthesis with enhanced Context Coherence. To capture spatial interdependence, we propose a novel module named Co-Resampler, which employs an advanced masked attention mechanism to jointly extract features from both the foreground and background while modeling their mutual relationships. Furthermore, we introduce a text-to-layout prediction module powered by Large Language Models (LLMs) and a reference image retrieval mechanism for providing rich textural guidance, which work together to enable CC-Diff++ to generate outputs that are both more diverse and more realistic. Extensive experiments demonstrate that CC-Diff++ outperforms state-of-the-art methods in visual fidelity, semantic accuracy, and positional precision on multiple RS datasets. CC-Diff++ also shows strong trainability, improving detection accuracy by 2.04 mAP on DOTA and 11.81 mAP on the HRSC dataset.Keywords
Funding Information
- National Natural Science Foundation of China (62225208, 62450046, 62406304, 62176260)
- General Program of China Postdoctoral Science Foundation (2023M743442)
- Postdoctoral Fellowship Program of China Postdoctoral Science Foundation (GZB20240730)
This publication has 45 references indexed in Scilit:
- RSDiff: remote sensing image generation from text using diffusion modelNeural Computing and Applications, 2024
- SpaText: Spatio-Textual Representation for Controllable Image Generation2023
- LayoutDiffusion: Controllable Diffusion Model for Layout-to-Image Generation2023
- ReCo: Region-Controlled Text-to-Image Generation2023
- High-Resolution Image Synthesis with Latent Diffusion Models2022
- Cross-Modal Contrastive Learning for Text-to-Image Generation2021
- Putting Visual Object Recognition in ContextConference on Computer Vision and Pattern Recognition (CVPR), 2020
- Image Generation From Layout2019
- DOTA: A Large-Scale Dataset for Object Detection in Aerial Images2018
- AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks2018