1. [Publications](/publications)
2. Magic3D: High-Resolution Text-to-3D Content Creation
 
 # Magic3D: High-Resolution Text-to-3D Content Creation

  ![Publication image](/sites/default/files/styles/wide/public/default_images/default.jpeg?itok=qUFsuJCP "Publication image")

 DreamFusion has recently demonstrated the utility of a pre-trained text-to-image diffusion model to optimize Neural Radiance Fields (NeRF), achieving remarkable text-to-3D synthesis results. However, the method has two inherent limitations: (a) extremely slow optimization of NeRF and (b) low-resolution image space supervision on NeRF, leading to low-quality 3D models with a long processing time. In this paper, we address these limitations by utilizing a two-stage optimization framework. First, we obtain a coarse model using a low-resolution diffusion prior and accelerate with a sparse 3D hash grid structure. Using the coarse representation as the initialization, we further optimize a textured 3D mesh model with an efficient differentiable renderer interacting with a high-resolution latent diffusion model. Our method, dubbed Magic3D, can create high quality 3D mesh models in 40 minutes, which is 2× faster than DreamFusion (reportedly taking 1.5 hours on average), while also achieving higher resolution. User studies show 61.7% raters to prefer our approach over DreamFusion. Together with the image-conditioned generation capabilities, we provide users with new ways to control 3D synthesis, opening up new avenues to various creative applications.



 ## Authors



[Chen-Hsuan Lin](/person/chen-hsuan-lin)

Jun Gao (NVIDIA)

Luming Tang (NVIDIA)

Towaki Takikawa (NVIDIA)

Xiaohui Zeng (NVIDIA)

Xun Huang (NVIDIA)

[Karsten Kreis](/person/karsten-kreis)

Sanja Fidler (NVIDIA)

[Ming-Yu Liu](/person/ming-yu-liu)

[Tsung-Yi Lin](/person/tsung-yi-lin)

 

 

 ## Publication Date



Thursday, June 1, 2023

 

 ## Published in



[CVPR 2023 (Highlight)](https://cvpr2023.thecvf.com/)

 

 ## Research Area



[Artificial Intelligence and Machine Learning ](/research-area/machine-learning-artificial-intelligence)

[Computer Graphics](/research-area/computer-graphics)

[Computer Vision](/research-area/computer-vision)

[Generative AI](/research-area/generative-ai)

 

 

 ## External Links



[Project Page](https://research.nvidia.com/labs/dir/magic3d)