NVIDIA Deep Imagination Research Group consists of a group of researchers passionate
about deep generative models and their applications in content creation. NVIDIA
Canvas/GauGAN and NVIDIA Maxine/LivePortrait are two products enabled by their
research. Below contains a list of their recent publications.
NVIDIA Deep Imagination Research Group consists of a group of researchers passionate
about deep generative models and their applications in content creation. NVIDIA
Canvas/GauGAN and NVIDIA Maxine/LivePortrait are two products enabled by their
research. Below contains a list of their recent publications.
| Magic3D: High-Resolution Text-to-3D Content Creation Chen-Hsuan Lin*, Jun Gao*, Luming Tang*, Towaki Takikawa*, Xiaohui Zeng* Xun Huang, Karsten Kreis, Sanja Fidler†, Ming-Yu Liu, Tsung-Yi Lin arxiv 2211.09809 [Project] [Video] |
|
eDIFF-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers Yogesh Balaji, Seungjun Nah, Xun Huang, Arash Vahdat, Jiaming Song, Karsten Kreis, Miika Aittala, Timo Aila, Samuli Laine, Bryan Catanzaro, Tero Karras, Ming-Yu Liu arxiv 2211.01324 [Project] [Video] |
|
SPACE: Speech-driven Portrait Animation with Controllable Expression Siddharth Gururani, Arun Mallya, Ting-Chun Wang, Rafael Valle, Ming-Yu Liu arxiv 2211.09809 [Project] [Video] |
|
Implicit Warping for Animation with Image Sets Arun Mallya, Ting-Chun Wang, Ming-Yu Liu NeurIPS 2022 [Project] |
|
Lumos: Learning to Relight Portrait Images via a Virtual Light Stage and Synthetic-to-Real Adaptation Yu-Ying Yeh, Koki Nagano, Sameh Khamis, Jan Kautz, Ming-Yu Liu, Ting-Chun Wang SIGGRAPH ASIA 2022 [Project] [Demo] [Video] |
|
Multimodal Conditional Image Synthesis with Product-of-Experts GANs Xun Huang, Arun Mallya, Ting-Chun Wang, Ming-Yu Liu ECCV 2022 [Project] |
|
I am AI: AI-driven Digital Avatar Made Easy Ming-Yu Liu, Koki Nagano, Yeongho Seol, Rafael Valle, Jaewoo Seo, Ting-Chun Wang, Arun Mallya, Sameh Khamis, Wei Ping, Rohan Badlani, Kevin J. Shih, Bryan Catanzaro, Simon Yuen, Jan Kautz SIGGRAPH RTL 2021 (Best-in-Show) |
|
GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worlds Zekun Hao, Arun Mallya, Serge Belongie, Ming-Yu Liu ICCV 2021 (Oral) [Project] [Video] |
|
One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing Ting-Chun Wang, Arun Mallya, Ming-Yu Liu CVPR 2021 (Oral) [Project] [Demo] [Video] |
|
Generative Adversarial Networks for Image and Video Synthesis: Algorithms and Applications Ming-Yu Liu, Xun Huang, Jiahui Yu, Ting-Chun Wang, Arun Mallya Proceedings of the IEEE, 2021 |
|
COCO-FUNIT: Few-Shot Unsupervised Image Translation with a Content Conditioned Style Encoder Kuniaki Saito, Kate Saenko, Ming-Yu Liu ECCV 2020 (Spotlight) [Project] [Code] [Video] |
|
World-Consistent Video-to-Video Synthesis Arun Mallya, Ting-Chun Wang, Karan Sapra, Ming-Yu Liu ECCV 2020 [Project] [Video] |
|
|
Few-Shot Video-to-Video Synthesis Ting-Chun Wang, Ming-Yu Liu, Andrew Tao, Guilin Liu, Jan Kautz, Bryan Catanzaro NeurIPS 2019 [Project] [Video] |
|
Few-Shot Unsupervised Image-to-Image Translation Ming-Yu Liu, Xun Huang, Arun Mallya, Tero Karras, Timo Aila, Jaakko Lehtinen, Jan Kautz ICCV 2019 [Project] [Demo] |
|
GauGAN: Semantic Image Synthesis With Spatially Adaptive Normalization Taesung Park, Chris Hebert, Ting-Chun Wang, Jun-Yan Zhu, Gavriil Klimov, Ming-Yu Liu SIGGRAPH Real-Time-Live 2019 (Best-in-Show, Audience Choice) |
|
Semantic Image Synthesis with Spatially-Adaptive Normalization Taesung Park, Ming-Yu Liu, Ting-Chun Wang, Jun-Yan Zhu CVPR 2019 (Oral, Best Paper Finalist) [Project] [Demo] [Video] |
|
Video-to-Video Synthesis Ting-Chun Wang, Ming-Yu Liu, Jun-Yan Zhu, Guilin Liu, Andrew Tao, Jan Kautz, Bryan Catanzaro NeurIPS 2018 [Project] [Video] |
|
Multimodal Unsupervised Image-to-Image Translation Xun Huang, Ming-Yu Liu, Serge Belongie, Jan Kautz ECCV 2018 [Video] |
|
|
A Closed-form Solution to Photorealistic Image Stylization Yijun Li, Ming-Yu Liu, Xueting Li, Ming-Hsuan Yang, Jan Kautz ECCV 2018 [Video] |
|
High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs Ting-Chun Wang, Ming-Yu Liu, Jun-Yan Zhu, Andrew Tao, Jan Kautz, Bryan Catanzaro CVPR 2018 (Oral) |
|
MoCoGAN: Decomposing Motion and Content for Video Generation Sergey Tulyakov, Ming-Yu Liu, Xiaodong Yang, Jan Kautz CVPR 2018 |
|
Unsupervised Image-to-Image Translation Networks Ming-Yu Liu, Thomas Breuel, Jan Kautz NeurIPS 2017 |