Reasoning for Generation, Generation for Reasoning: A Survey of Unified Multimodal Models
Preprint
- 3 November 2026
- preprint
- Published by MDPI AG in Preprints.org
Abstract
Unified multimodal models (UMMs) integrate visual understanding and image generation, creating the opportunity for each capability to strengthen the other. However, architectural unification does not guarantee such interaction: models frequently understand visual requirements that they fail to realize in generated images, and generate intermediate images that their reasoning does not use. This survey examines both directions of transfer and why each remains challenging. We review the architectural foundations and representative model families, and the tasks in which understanding and generation must interact. For understanding → generation, we organize methods into training-free approaches that improve inference with frozen components and training-based approaches that learn reasoning, alignment, verification, or refinement, and compare them by stage of intervention, required access, and computational cost. For generation → reasoning, we review visual-imagination methods that reason with generated images, latent visual tokens, geometric representations, drawing tools, or external world models. We further examine evaluation protocols that distinguish individual task performance, cross-modal consistency, and genuine synergy. Across both directions, a shared challenge emerges: a correct intermediate, whether a reasoning trace or an imagined image, is not necessarily used. We conclude with open problems in reasoning-to-generation alignment, verifiable imagination, reliable self-correction, and compute-matched evaluation.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Instruction-based image editing: a survey on data, models, evaluation, and applicationsVicinagearth, 2026
- Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmark2026
- T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generation2026
- Test-Time Scaling in Multimodal Foundation Models: A Comprehensive Survey of Generation and Reasoning2026
- Towards Unified Multimodal Large Language Models: A survey2026
- Revealing the Seen, Imagining the Beyond: A Survey of Image-Grounded Chain-of-Thought Reasoning in Multimodal LLMs2026
- Large multimodal models evaluation: a surveyScience China Information Sciences, 2025
- Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generation2025
- Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation ModelsarXiv, 2025
- R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generation2025