MV-Adapter: Multi-view Consistent Image Generation Made Easy
Preprint
Abstract
Existing multi-view image generation methods often make invasive modifications to pre-trained text-to-image (T2I) models and require full fine-tuning, leading to (1) high computational costs, especially with large base models and high-resolution images, and (2) degradation in image quality due to optimization difficulties and scarce high-quality 3D data. In this paper, we propose the first adapter-based solution for multi-view image generation, and introduce MV-Adapter, a versatile plug-and-play adapter that enhances T2I models and their derivatives without altering the original network structure or feature space. By updating fewer parameters, MV-Adapter enables efficient training and preserves the prior knowledge embedded in pre-trained models, mitigating overfitting risks. To efficiently model the 3D geometric knowledge within the adapter, we introduce innovative designs that include duplicated self-attention layers and parallel attention architecture, enabling the adapter to inherit the powerful priors of the pre-trained models to model the novel 3D knowledge. Moreover, we present a unified condition encoder that seamlessly integrates camera parameters and geometric information, facilitating applications such as text- and image-based 3D generation and texturing. MV-Adapter achieves multi-view generation at 768 resolution on Stable Diffusion XL (SDXL), and demonstrates adaptability and versatility. It can also be extended to arbitrary view generation, enabling broader applications. We demonstrate that MV-Adapter sets a new quality standard for multi-view image generation, and opens up new possibilities due to its efficiency, adaptability and versatility.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Controllable Generation With Text-to-Image Diffusion Models: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2025
- Text-Guided Texturing by Synchronized Multi-View Diffusion2024
- StableNormal: Reducing Diffusion Variance for Stable and Sharp NormalACM Transactions on Graphics, 2024
- MoMA: Multimodal LLM Adapter for Fast Personalized Image Generation2024
- FlashTex: Fast Relightable Mesh Texturing with LightControlNet2024
- MVDiffusion++: A Dense High-Resolution Multi-view Diffusion Model for Single or Sparse-View 3D Object Reconstruction2024
- CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Model2024
- ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAs2024
- SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image Using Latent Video Diffusion2024
- T2I-Adapter: Learning Adapters to Dig Out More Controllable Ability for Text-to-Image Diffusion ModelsProceedings of the AAAI Conference on Artificial Intelligence, 2024