1. [Publications](/index.php/publications)
2. LATTE3D: Large-scale Amortized Text-To-Enhanced3D Synthesis
 
 # LATTE3D: Large-scale Amortized Text-To-Enhanced3D Synthesis

  ![](/sites/default/files/styles/wide/public/publications/Latte3D.png?itok=ZO0xyqlm)

 Recent text-to-3D generation approaches produce impressive 3D results but require time-consuming optimization that can take up to an hour per prompt. Amortized methods like ATT3D optimize multiple prompts simultaneously to improve efficiency, enabling fast text-to-3D synthesis. However, ATT3D cannot capture high-frequency geometry and texture details and struggles to scale to large prompt sets, so it generalizes poorly. We introduce Latte3D, addressing these limitations to achieve fast, high-quality generation on a significantly larger prompt set. Key to our method is 1) building a scalable architecture for amortized learning and 2) leveraging 3D data during optimization through 3D-aware diffusion priors, shape regularization, and model initialization to achieve robustness to diverse and complex training prompts. Latte3D amortizes both neural field generation and textured surface generation to produce highly detailed textured meshes in a single forward pass. Latte3D generates 3D objects in 400ms, and can be further enhanced with fast test-time optimization.



 ## Authors



Kevin Xie (NVIDIA)

Jonathan Lorraine (NVIDIA)

Tianshi Cao (NVIDIA)

Jun Gao (NVIDIA)

 James Lucas (NVIDIA)

Antonio Torralba (NVIDIA)

Sanja Fidler (NVIDIA)

Xiaohui Zeng (NVIDIA)

 

 

 ## Publication Date



Wednesday, March 20, 2024

 

 ## Published in



[ECCV](https://eccv2024.ecva.net/)

 

 ## Research Area



[Artificial Intelligence and Machine Learning ](/index.php/research-area/machine-learning-artificial-intelligence)

[Computer Graphics](/index.php/research-area/computer-graphics)

[Generative AI](/index.php/research-area/generative-ai)

 

 

 ## External Links



[Paper](https://arxiv.org/abs/2403.15385)

[Project Page](https://research.nvidia.com/labs/toronto-ai/LATTE3D/)

[30 Second Summary Video](https://drive.google.com/file/d/12QkEj_PBBPTqSmiz0bkTbJIt_Ga4fR88/view?usp=drive_link)

[3 Minute Summary Video](https://drive.google.com/file/d/1xUbWTk92NJ9ThQibmNs6LvOnkj47za7-/view?usp=drive_link)