HD-Fusion: Detailed Text-to-3D Generation Leveraging Multiple Noise Estimation
Authors:
- 3 January 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3190-3199
Abstract
In this paper, we study Text-to-3D content generation leveraging 2D diffusion priors to enhance the quality and detail of the generated 3D models. Recent progress [11] in text-to-3D has shown that employing high-resolution (e.g., 512 × 512) renderings can lead to the production of high-quality 3D models using latent diffusion priors. To enable rendering at even higher resolutions, which has the potential to further augment the quality and detail of the models, we propose a novel approach that combines multiple noise estimation processes with a pretrained 2D diffusion prior. Distinct from the Bar-Tal et al.s’ study which binds multiple denoised results [1] to generate images from texts, our approach integrates the computation of scoring distillation losses such as SDS loss and VSD loss which are essential techniques for the 3D content generation with 2D diffusion priors. We experimentally evaluated the proposed approach. The results show that the proposed approach can generate high-quality details compared to the baselines.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Magic3D: High-Resolution Text-to-3D Content Creation2023
- Latent-NeRF for Shape-Guided Generation of 3D Shapes and Textures2023
- High-Resolution Image Synthesis with Latent Diffusion Models2022
- Taming Transformers for High-Resolution Image Synthesis2021
- NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis2020
- Pushing the Boundaries of View Extrapolation With Multiplane Images2019
- DeepVoxels: Learning Persistent 3D Feature Embeddings2019
- 3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction2016
- A Theory of Shape by Space CarvingInternational Journal of Computer Vision, 2000
- Photorealistic Scene Reconstruction by Voxel ColoringInternational Journal of Computer Vision, 1999