Publications

Chunggi Lee, Seonwook Park, Wanhua Li, Umar Iqbal, Hanspeter Pfister (2026). DETRAM: End-to-end DEtection, Tracking and Recovery of HumAn Meshes. European Conference on Computer Vision (ECCV).

Pdf

Timo Teufel, Xilong Zhou, Umar Iqbal, Jan Kautz, Marc Habermann, Vladislav Golyanik, Christian Theobalt (2026). D-Rex: Diffusion Rendering for Relightable Expressive Avatars. European Conference on Computer Vision (ECCV).

Website Pdf

Zhengyi Luo, Ye Yuan, Tingwu Wang, Chenran Li, Sirui Chen, Fernando Castañeda, Zi-Ang Cao, Jiefeng Li, David Minor, Qingwei Ben, Xingye Da, Runyu Ding, Cyrus Hogg, Lina Song, Edy Lim, Eugene Jeon, Tairan He, Haoru Xue, Wenli Xiao, Zi Wang, Simon Yuen, Jan Kautz, Yan Chang, Umar Iqbal, Linxi Fan, Yuke Zhu (2026). SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Control. Science Robotics.

Website Pdf

Tingwu Wang, Olivier Dionne, Michael de Ruyter, David Minor, Davis Rempe, Kaifeng Zhao, Mathis Petrovich, Ye Yuan, Chenran Li, Zhengyi Luo, Brian Robison, Xavier Blackwell, Bernardo Antoniazzi, Xue Bin (Jason) Peng, Yuke Zhu, Simon Yuen (2026). MotionBricks: Scalable Real-Time Motions with Modular Latent Generative Model and Smart Primitives. ACM Transactions on Graphics (SIGGRAPH).

arXiv Website

Jiashun Wang, Yifeng Jiang, Haotian Zhang, Chen Tessler, Davis Rempe, Jessica Hodgins, Xue Bin (Jason) Peng (2026). HIL: Hybrid Imitation Learning for Dynamic Athletic Control. ACM Transactions on Graphics (ToG).

arXiv Website Pdf

Yi Shi, Yifeng Jiang, Chen Tessler, Xue Bin (Jason) Peng (2026). GPC: Large-Scale Generative Pretraining for Transferable Motor Control. Proceedings of SIGGRAPH.

arXiv Website

Sunmin Lee, Davis Rempe, Yifeng Jiang, Haotian Zhang, Tingwu Wang, Jungdam Won, Xue Bin (Jason) Peng (2026). DMP: Directable Motion Retargeting through Motion Paraphrasing. ACM Transactions on Graphics (ToG).

Pdf

Kaifeng Zhao, Mathis Petrovich, Haotian Zhang, Tingwu Wang, Siyu Tang, Davis Rempe (2026). ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generation. ACM Transactions on Graphics (SIGGRAPH).

arXiv Website

Tianyi Xie, Haotian Zhang, Jinhyung (David) Park, Zi Wang, Bowen Wen, Jiefeng Li, Xueting Li, Qingwei Ben, Haoyang Weng, Yufei (Judy) Ye, David Minor, Tingwu Wang, Chenfanfu Jiang, Sanja Fidler, Jan Kautz, Linxi Fan, Yuke Zhu, Zhengyi Luo, Umar Iqbal, Ye Yuan (2026). GRAIL: Generating Humanoid Loco-Manipulation from 3D Assets and Video Priors. ArXiv Preprint.

Website Pdf

Enrico Pallotta, Sina Mokhtarzadeh Azar, Lars Doorenbos, Serdar Ozsoy, Umar Iqbal, Juergen Gall (2026). EgoControl: Controllable Egocentric Video Generation via 3D Full-Body Poses. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

arXiv Website

Jun Saito, Jiefeng Li, Michael de Ruyter, Miguel Guerrero, Edy Lim, Ehsan Hassani, Roger Blanco Ribera, Hyejin Moon, Magdalena Dadela, Marco Di Lucca, Qiao Wang, Xueting Li, Jan Kautz, Simon Yuen, Umar Iqbal (2026). SOMA: Unifying Parametric Human Body Models. ArXiv Preprint.

arXiv Website Pdf

Davis Rempe, Mathis Petrovich, Ye Yuan, Haotian Zhang, Xue Bin (Jason) Peng, Yifeng Jiang, Tingwu Wang, Umar Iqbal, David Minor, Michael de Ruyter, Jiefeng Li, Chen Tessler, Edy Lim, Eugene Jeong, Sam Wu, Ehsan Hassani, Michael Huang, Jin-Bey Yu, Chaeyeon Chung, Lina Song, Olivier Dionne, Jan Kautz, Simon Yuen, Sanja Fidler (2026). Kimodo: Scaling Controllable Human Motion Generation. ArXiv Preprint.

arXiv Website

Marcel Buehler, Ye Yuan, Xueting Li, Yangyi Huang, Koki Nagano, Umar Iqbal (2026). Dream, Lift, Animate: From Single Images to Animatable Gaussian Avatars. International Conference on 3D Vision (3DV).

arXiv

Timo Teufel, Xilong Zhou, Umar Iqbal, Pramod Rao, Pulkit Gera, Jan Kautz, Vladislav Golyanik, Christian Theobalt (2025). HumanOLAT: A Large-Scale Dataset for Full-Body Human Relighting and Novel-View Synthesis. IEEE International Conference on Computer Vision (ICCV).

arXiv Website

Gwanghyun Kim, Xueting Li, Ye Yuan, Koki Nagano, Tianye Li, Jan Kautz, Se Young Chun, Umar Iqbal (2025). GeoMan: Temporally Consistent Human Geometry Estimation using Image-to-Video Diffusion. IEEE International Conference on Computer Vision (ICCV).

arXiv Website

Jiefeng Li, Jinkun Cao, Haotian Zhang, Davis Rempe, Jan Kautz, Umar Iqbal, Ye Yuan (2025). GENMO: A GENeralist Model for Human MOtion. IEEE International Conference on Computer Vision (ICCV).

arXiv Website

Yangyi Huang, Ye Yuan, Xueting Li, Jan Kautz, Umar Iqbal (2025). AdaHuman: Animatable Detailed 3D Human Generation with Compositional Multiview Diffusion. IEEE International Conference on Computer Vision (ICCV).

arXiv Website

Xueting Li, Ye Yuan, Shalini De Mello, Gilles Daviet, Jonathan Leaf, Miles Macklin, Jan Kautz, Umar Iqbal (2025). SimAvatar: Simulation-Ready Avatars with Layered Hair and Clothing. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

arXiv Website

Jiawei Ren, Kevin Xie, Ashkan Mirzaei, Hanxue Liang, Xiaohui Zeng, Karsten Kreis, Ziwei Liu, Antonio Torralba, Sanja Fidler, Seung Wook Kim, Huan Ling (2024). L4GM: Large 4D Gaussian Reconstruction Model. Advances in Neural Information Processing Systems (NeurIPS).

arXiv

Zhenyu Jiang, Yuqi Xie, Jinhan Li, Ye Yuan, Yifeng Zhu, Yuke Zhu (2024). Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptions. Conference on Robot Learning (CoRL).

arXiv Website

Dejia Xu, Ye Yuan, Morteza Mardani, Sifei Liu, Jiaming Song, Zhangyang Wang, Arash Vahdat (2024). AGG: Amortized Generative 3D Gaussians for Single Image to 3D. Transactions on Machine Learning Research.

arXiv Website

Jifeng Li, Ye Yuan, Davis Rempe, Haotian Zhang, Pavlo Molchanov, Cewu Lu, Jan Kautz, Umar Iqbal (2024). COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation. European Conference on Computer Vision (ECCV).

arXiv Website

Alex Trevithick, Matthew Chan, Towaki Takikawa, Umar Iqbal, Shalini De Mello, Manmohan Chandraker, Ravi Ramamoorthi, Koki Nagano (2024). Rendering Every Pixel for High-Fidelity Geometry in 3D GANs. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

arXiv

Mathis Petrovich, Or Litany, Umar Iqbal, Michael J. Black, Gül Varol, Xue Bin (Jason) Peng, Davis Rempe (2024). Multi-Track Timeline Control for Text-Driven 3D Human Motion Generation. CVPR Workshop on Human Motion Generation (HuMoGen).

arXiv

Ye Yuan, Xueting Li, Yangyi Huang, Shalini De Mello, Koki Nagano, Jan Kautz, Umar Iqbal (2024). GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Highlight.

arXiv Website

Yufeng Zheng, Xueting Li, Koki Nagano, Sifei Liu, Karsten Kreis, Otmar Hilliges, Shalini De Mello (2024). Dream-in-4D: A Unified Approach for Text- and Image-guided 4D Scene Generation. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

arXiv Website

Yang Fu, Shalini De Mello, Xueting Li, Amey Kulkarni, Jan Kautz, Xiaolong Wang, Sifei Liu (2024). 3D Reconstruction with Generalizable Neural Fields using Scene Priors. International Conference on Learning Representations (ICLR).

arXiv Website

Muhammed Kocabas, Ye Yuan, Pavlo Molchanov, Yunrong Guo, Michael Black, Otmar Hilliges, Jan Kautz, Umar Iqbal (2024). PACE: Human and Camera Motion Estimation from in-the-wild Videos. International Conference on 3D Vision (3DV)
Spotlight.

arXiv

Xueting Li, Shalini De Mello, Sifei Liu, Koki Nagano, Umar Iqbal, Jan Kautz (2023). Generalizable One-shot Neural Head Avatar. Advances in Neural Information Processing Systems (NeurIPS).

arXiv

Umar Iqbal, Akin Caliskan, Koki Nagano, Sameh Khamis, Pavlo Molchanov, Jan Kautz (2023). RANA: Relightable and Articulated Neural Avatars. IEEE International Conference on Computer Vision (ICCV).

arXiv Website

Ye Yuan, Jiaming Song, Umar Iqbal, Arash Vahdat, Jan Kautz (2023). PhysDiff: Physics-Guided Human Motion Diffusion Model. IEEE International Conference on Computer Vision (ICCV)
Oral.

arXiv Website

Jingbo Wang, Ye Yuan, Zhengyi Luo, Kevin Xie, Dahua Lin, Umar Iqbal, Sanja Fidler, Sameh Khamis (2023). Learning Human Dynamics in Autonomous Driving Scenarios. IEEE International Conference on Computer Vision (ICCV).

Pdf

Connor Lin, Koki Nagano, Jan Kautz, Eric Chan, Umar Iqbal, Leonidas Guibas, Gordon Wetzstein, Sameh Khamis (2023). Single-Shot Implicit Morphable Faces with Consistent Texture Parameterization. ACM Transactions on Graphics (SIGGRAPH).

arXiv Website

Haotian Zhang, Ye Yuan, Viktor Makoviychuk, Yunrong Guo, Sanja Fidler, Xue Bin (Jason) Peng, Kayvon Fatahalian (2023). Learning Physically Simulated Tennis Players from Broadcast Videos. ACM Transactions on Graphics (SIGGRAPH)
Best paper honorable mention.

arXiv

Jiashun Wang, Xueting Li, Sifei Liu, Shalini De Mello, Orazio Gallo, Xiaolong Wang, Jan Kautz (2023). Zero-shot Pose Transfer for Unrigged Stylized 3D Characters. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

Pdf

Davis Rempe, Zhengyi Luo, Xue Bin (Jason) Peng, Ye Yuan, Kris Kitani, Karsten Kreis, Sanja Fidler, Or Litany (2023). Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

arXiv Website

Yufei (Judy) Ye, Xueting Li, Abhinav Gupta, Shalini De Mello, Stan Birchfield, Jiaming Song, Shubham Tulsiani, Sifei Liu (2023). Affordance Diffusion: Synthesizing Hand-Object Interactions. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

arXiv Website Video

Zhenggang Tang, Balakumar Sundaralingam, Jonathan Tremblay, Bowen Wen, Ye Yuan, Stephen Tyree, Charles Loop, Alexander Schwing, Stan Birchfield (2023). RGB-Only Reconstruction of Tabletop Scenes for Collision-Free Manipulator Control. International Conference on Robotics and Automation (ICRA).

arXiv Website Video

Zhengyi Luo, Shun Iwase, Ye Yuan, Kris Kitani (2022). Embodied Scene-aware Human Pose Estimation. Advances in Neural Information Processing Systems (NeurIPS).

arXiv Website Video

Xueting Li, Sifei Liu, Xiaolong Wang, Ming-Hsuan Yang, Alyosha Efros (2022). Scraping Textures from Natural Images for Synthesis and Editing. European Conference on Computer Vision (ECCV).

Website Pdf Video

An-Chieh Cheng, Xueting Li, Sifei Liu, Min Sun, Ming-Hsuan Yang (2022). Autoregressive 3D shape generation via canonical mapping. European Conference on Computer Vision (ECCV).

arXiv

Atsuhiro Noguchi, Umar Iqbal, Jonathan Tremblay, Tatsuya Harada, Orazio Gallo (2022). Watch It Move: Unsupervised Discovery of 3D Joints for Re-Posing of Articulated Objects. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

arXiv Website

Ye Yuan, Umar Iqbal, Pavlo Molchanov, Kris Kitani, Jan Kautz (2022). GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Cameras. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Oral.

arXiv Website

Amit Raj, Umar Iqbal, Koki Nagano, Sameh Khamis, Pavlo Molchanov, James Hays, Jan Kautz (2022). DRaCoN--Differentiable Rasterization Conditioned Neural Radiance Fields for Articulated Avatars. ArXiv Preprint.

arXiv Website

Umar Iqbal, Kevin Xie, Yunrong Guo, Jan Kautz, Pavlo Molchanov (2021). KAMA: 3D Keypoint Aware Body Mesh Articulation. International Conference on 3D Vision (3DV).

arXiv Video

Siva Karthik Mustikovela, Shalini De Mello, Aayush Prakash, Umar Iqbal, Sifei Liu, Thu Nguyen-Phuoc, Carsten Rother, Jan Kautz (2021). Self-Supervised Object Detection via Generative Image Synthesis. IEEE International Conference on Computer Vision (ICCV).

arXiv

Rakshit Kothari, Shalini De Mello, Umar Iqbal, Wonmin Byeon, Seonwook Park, Jan Kautz (2021). Weakly-Supervised Physically Unconstrained Gaze Estimation. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Oral.

arXiv

Yang Fu, Sifei Liu, Umar Iqbal, Shalini De Mello, Humphrey Shi, Jan Kautz (2021). Learning to Track Instances without Video Annotations. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

Yu-Wei Chao, Wei Yang, Yu Xiang, Pavlo Molchanov, Ankur Handa, Jonathan Tremblay, Yashraj S. Narang, Karl Van Wyk, Umar Iqbal, Stan Birchfield, Jan Kautz, Dieter Fox (2021). DexYCB: A Benchmark for Capturing Hand Grasping of Objects. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

arXiv Project

Adrian Spurr, Pavlo Molchanov, Umar Iqbal, Jan Kautz, Otmar Hilliges (2021). Adversarial Motion Modelling Helps Semi-Supervised Hand Pose Estimation. ArXiv Preprint.

arXiv

Xueting Li, Shalini De Mello, Xiaolong Wang, Ming-Hsuan Yang, Jan Kautz, Sifei Liu (2021). Learning continuous environment fields via implicit functions. International Conference on Learning Representations (ICLR).

arXiv

Xueting Li, Sifei Liu, Shalini De Mello, Kihwan Kim, Xiaolong Wang, Ming-Hsuan Yang, Jan Kautz (2020). Online adaptation for consistent mesh reconstruction in the wild. Advances in Neural Information Processing Systems (NeurIPS).

Video

Xueting Li, Sifei Liu, Kihwan Kim, Shalini De Mello, Varun Jampani, Ming-Hsuan Yang, Jan Kautz (2020). Self-supervised single-view 3D reconstruction via semantic consistency. European Conference on Computer Vision (ECCV).

Video

Umar Iqbal, Pavlo Molchanov, Jan Kautz (2020). Weakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wild. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

arXiv

Siva Karthik Mustikovela, Varun Jampani, Shalini De Mello, Umar Iqbal, Sifei Liu, Carsten Rother, Jan Kautz (2020). Self-Supervised Viewpoint Learning from Image Collections. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

arXiv