Publications

Zhenyu Jiang, Yuqi Xie, Jinhan Li, Ye Yuan, Yifeng Zhu, Yuke Zhu (2024). Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptions. Conference on Robot Learning (CoRL).

Jifeng Li, Ye Yuan, Davis Rempe, Haotian Zhang, Pavlo Molchanov, Cewu Lu, Jan Kautz, Umar Iqbal (2024). COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation. European Conference on Computer Vision (ECCV).

Alex Trevithick, Matthew Chan, Towaki Takikawa, Umar Iqbal, Shalini De Mello, Manmohan Chandraker, Ravi Ramamoorthi, Koki Nagano (2024). Rendering Every Pixel for High-Fidelity Geometry in 3D GANs. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

Mathis Petrovich, Or Litany, Umar Iqbal, Michael J. Black, Gül Varol, Xue Bin Peng, Davis Rempe (2024). Multi-Track Timeline Control for Text-Driven 3D Human Motion Generation. CVPR Workshop on Human Motion Generation (HuMoGen).

Ye Yuan, Xueting Li, Yangyi Huang, Shalini De Mello, Koki Nagano, Jan Kautz, Umar Iqbal (2024). GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Highlight.

Yufeng Zheng, Xueting Li, Koki Nagano, Sifei Liu, Karsten Kreis, Otmar Hilliges, Shalini De Mello (2024). Dream-in-4D: A Unified Approach for Text- and Image-guided 4D Scene Generation. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

Yang Fu, Shalini De Mello, Xueting Li, Amey Kulkarni, Jan Kautz, Xiaolong Wang, Sifei Liu (2024). 3D Reconstruction with Generalizable Neural Fields using Scene Priors. International Conference on Learning Representations (ICLR).

Muhammed Kocabas, Ye Yuan, Pavlo Molchanov, Yunrong Guo, Michael Black, Otmar Hilliges, Jan Kautz, Umar Iqbal (2024). PACE: Human and Camera Motion Estimation from in-the-wild Videos. International Conference on 3D Vision (3DV)
Spotlight.

Xueting Li, Shalini De Mello, Sifei Liu, Koki Nagano, Umar Iqbal, Jan Kautz (2023). Generalizable One-shot Neural Head Avatar. Advances in Neural Information Processing Systems (NeurIPS).

Umar Iqbal, Akin Caliskan, Koki Nagano, Sameh Khamis, Pavlo Molchanov, Jan Kautz (2023). RANA: Relightable and Articulated Neural Avatars. IEEE International Conference on Computer Vision (ICCV).

Ye Yuan, Jiaming Song, Umar Iqbal, Arash Vahdat, Jan Kautz (2023). PhysDiff: Physics-Guided Human Motion Diffusion Model. IEEE International Conference on Computer Vision (ICCV)
Oral.

Jingbo Wang, Ye Yuan, Zhengyi Luo, Kevin Xie, Dahua Lin, Umar Iqbal, Sanja Fidler, Sameh Khamis (2023). Learning Human Dynamics in Autonomous Driving Scenarios. IEEE International Conference on Computer Vision (ICCV).

Connor Lin, Koki Nagano, Jan Kautz, Eric Chan, Umar Iqbal, Leonidas Guibas, Gordon Wetzstein, Sameh Khamis (2023). Single-Shot Implicit Morphable Faces with Consistent Texture Parameterization. ACM Transactions on Graphics (SIGGRAPH).

Haotian Zhang, Ye Yuan, Viktor Makoviychuk, Yunrong Guo, Sanja Fidler, Xue Bin Peng, Kayvon Fatahalian (2023). Learning Physically Simulated Tennis Players from Broadcast Videos. ACM Transactions on Graphics (SIGGRAPH)
Best paper honorable mention.

Jiashun Wang, Xueting Li, Sifei Liu, Shalini De Mello, Orazio Gallo, Xiaolong Wang, Jan Kautz (2023). Zero-shot Pose Transfer for Unrigged Stylized 3D Characters. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

Davis Rempe, Zhengyi Luo, Xue Bin Peng, Ye Yuan, Kris Kitani, Karsten Kreis, Sanja Fidler, Or Litany (2023). Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

Yufei Ye, Xueting Li, Abhinav Gupta, Shalini De Mello, Stan Birchfield, Jiaming Song, Shubham Tulsiani, Sifei Liu (2023). Affordance Diffusion: Synthesizing Hand-Object Interactions. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

arXiv Website video

Zhenggang Tang, Balakumar Sundaralingam, Jonathan Tremblay, Bowen Wen, Ye Yuan, Stephen Tyree, Charles Loop, Alexander Schwing, Stan Birchfield (2023). RGB-Only Reconstruction of Tabletop Scenes for Collision-Free Manipulator Control. International Conference on Robotics and Automation (ICRA).

arXiv Website video

Zhengyi Luo, Shun Iwase, Ye Yuan, Kris Kitani (2022). Embodied Scene-aware Human Pose Estimation. Advances in Neural Information Processing Systems (NeurIPS).

arXiv Website video

Xueting Li, Sifei Liu, Xiaolong Wang, Ming-Hsuan Yang, Alyosha Efros (2022). Scraping Textures from Natural Images for Synthesis and Editing. European Conference on Computer Vision (ECCV).

Website pdf video

An-Chieh Cheng, Xueting Li, Sifei Liu, Min Sun, Ming-Hsuan Yang (2022). Autoregressive 3D shape generation via canonical mapping. European Conference on Computer Vision (ECCV).

Atsuhiro Noguchi, Umar Iqbal, Jonathan Tremblay, Tatsuya Harada, Orazio Gallo (2022). Watch It Move: Unsupervised Discovery of 3D Joints for Re-Posing of Articulated Objects. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

Ye Yuan, Umar Iqbal, Pavlo Molchanov, Kris Kitani, Jan Kautz (2022). GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Cameras. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Oral.

Amit Raj, Umar Iqbal, Koki Nagano, Sameh Khamis, Pavlo Molchanov, James Hays, Jan Kautz (2022). DRaCoN--Differentiable Rasterization Conditioned Neural Radiance Fields for Articulated Avatars. ArXiv Preprint.

Umar Iqbal, Kevin Xie, Yunrong Guo, Jan Kautz, Pavlo Molchanov (2021). KAMA: 3D Keypoint Aware Body Mesh Articulation. International Conference on 3D Vision (3DV).

Siva Karthik Mustikovela, Shalini De Mello, Aayush Prakash, Umar Iqbal, Sifei Liu, Thu Nguyen-Phuoc, Carsten Rother, Jan Kautz (2021). Self-Supervised Object Detection via Generative Image Synthesis. IEEE International Conference on Computer Vision (ICCV).

Rakshit Kothari, Shalini De Mello, Umar Iqbal, Wonmin Byeon, Seonwook Park, Jan Kautz (2021). Weakly-Supervised Physically Unconstrained Gaze Estimation. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Oral.

Yang Fu, Sifei Liu, Umar Iqbal, Shalini De Mello, Humphrey Shi, Jan Kautz (2021). Learning to Track Instances without Video Annotations. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

Yu-Wei Chao, Wei Yang, Yu Xiang, Pavlo Molchanov, Ankur Handa, Jonathan Tremblay, Yashraj S. Narang, Karl Van Wyk, Umar Iqbal, Stan Birchfield, Jan Kautz, Dieter Fox (2021). DexYCB: A Benchmark for Capturing Hand Grasping of Objects. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

Adrian Spurr, Pavlo Molchanov, Umar Iqbal, Jan Kautz, Otmar Hilliges (2021). Adversarial Motion Modelling Helps Semi-Supervised Hand Pose Estimation. ArXiv Preprint.

Xueting Li, Shalini De Mello, Xiaolong Wang, Ming-Hsuan Yang, Jan Kautz, Sifei Liu (2021). Learning continuous environment fields via implicit functions. International Conference on Learning Representations (ICLR).

Xueting Li, Sifei Liu, Shalini De Mello, Kihwan Kim, Xiaolong Wang, Ming-Hsuan Yang, Jan Kautz (2020). Online adaptation for consistent mesh reconstruction in the wild. Advances in Neural Information Processing Systems (NeurIPS).

Xueting Li, Sifei Liu, Kihwan Kim, Shalini De Mello, Varun Jampani, Ming-Hsuan Yang, Jan Kautz (2020). Self-supervised single-view 3D reconstruction via semantic consistency. European Conference on Computer Vision (ECCV).

Umar Iqbal, Pavlo Molchanov, Jan Kautz (2020). Weakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wild. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

Siva Karthik Mustikovela, Varun Jampani, Shalini De Mello, Umar Iqbal, Sifei Liu, Carsten Rother, Jan Kautz (2020). Self-Supervised Viewpoint Learning from Image Collections. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).