Publications

Our publications provide insight into some of our leading-edge research.

Filters

Filters

Publication Year

Research Areas

Events

2023

FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularization
Jiawei Yang, Marco Pavone, Yue Wang
Object Pose Estimation with Statistical Guarantees: Conformal Keypoint Detection and Geometric Uncertainty Propagation
Heng Yang, Marco Pavone
Selected as a Highlight Paper
NeuralField-LDM: Scene Generation with Hierarchical Latent Diffusion Models
Seung Wook Kim, Bradley Brown, Kangxue Yin, Karsten Kreis, Katja Schwarz, Daiqing Li, Robin Rombach, Antonio Torralba, Sanja Fidler
Learning Human-to-Robot Handovers from Point Clouds
Sammy Christen, Wei Yang, Claudia Pérez D’Arpino , Otmar Hilliges, Dieter Fox, Yu-Wei Chao
Highlight
Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Models
Jiarui Xu, Sifei Liu, Arash Vahdat, Wonmin Byeon, Xiaolong Wang, Shalini De Mello
Hightlight top 10%
Zero-shot Pose Transfer for Unrigged Stylized 3D Characters
Jiashun Wang, Xueting Li, Sifei Liu, Shalini De Mello, Orazio Gallo, Xiaolong Wang, Jan Kautz
Neuralangelo: High-Fidelity Neural Surface Reconstruction
Max Zhaoshuo Li, Thomas Müller, Alex Evans, Russell H. Taylor, Mathias Unberath, Ming-Yu Liu, Chen-Hsuan Lin
The Best Inventions of 2023, TIME Magazine
Magic3D: High-Resolution Text-to-3D Content Creation
Chen-Hsuan Lin, Jun Gao, Luming Tang, Towaki Takikawa, Xiaohui Zeng, Xun Huang, Karsten Kreis, Sanja Fidler, Ming-Yu Liu, Tsung-Yi Lin
Parallel Inversion of Neural Radiance Fields for Robust Pose Estimation
Yunzhi Lin, Thomas Müller, Jonathan Tremblay, Bowen Wen, Stephen Tyree, Alex Evans, Patricio A. Vela, Stan Birchfield
The Best Defense is a Good Offense: Adversarial Augmentation against Adversarial Attacks
Iuri Frosio, Jan Kautz
Subpixel Deblurring of Anti-Aliased Raster Clip Art
Jinfan Yang, Nicholas Vining, Shakiba Kheradmand, Nathan Carr, Leonid Sigal, Alla Sheffer
GPViT: A High Resolution Non-Hierarchical Vision Transformer with Group Propagation
Chenhongyi Yang, Jiarui Xu, Shalini De Mello, Elliot J. Crowley, Xiaolong Wang
Notable top 25%
Oral
Robust and Controllable Object-Centric Learning through Energy-based Models
Ruixiang Zhang, Gerry Che, Boris Ivanovic, Renhao Wang, Marco Pavone, Yoshua Bengio, Liam Paull
Target-free Text-guided Image Manipulation
Wan-Cyuan Fan, Cheng-Fu Yang, Chiao-An Yang, Frank Wang
Frido: Feature Pyramid Diffusion for Complex Scene Image Synthesis
Wan-Cyuan Fan, Yen-Chun Chen, Dongdong Chen, Yu Cheng, Lu Yuan, Frank Wang
Self-Supervised Pyramid Representation Learning for Multi-Label Visual Analysis and Beyond
Cheng-Yen Hsieh, Chih-Jung Chang, Fu-En Yang, Frank Wang

2022

Task-Relevant Failure Detection for Trajectory Predictors in Autonomous Vehicles
Alec Farid, Sushant Veer, Boris Ivanovic, Karen Leung, Marco Pavone
Robust Trajectory Prediction against Adversarial Attacks
Yulong Cao, Danfei Xu, Xinshuo Weng, Z. Morely Mao, Anima Anandkumar, Chaowei Xiao, Marco Pavone
Selected for Oral Presentation
Motion Policy Networks
Adam Fishman, Adithya Murali, Clemens Eppner, Bryan Peele, Byron Boots, Dieter Fox
"This is my unicorn, Fluffy": Personalizing frozen vision-language representations
Niv Cohen, Rinon Gal, Eli Meirom, Gal Chechik, Yuval Atzmon
Paraphrasing Is All You Need for Novel Object Captioning
Cheng-Fu Yang, Yao-Hung Hubert Tsai, Wan-Cyuan Fan, Ruslan Salakhutdinov, Louis-Philippe Morency, Frank Wang
SPoVT: Semantic-Prototype Variational Transformer for Dense Point Cloud Semantic Completion
Sheng-Yu Huang, Hao-Yu Hsu, Yu-Chiang Frank Wang
GENIE: Higher-Order Denoising Diffusion Solvers
Tim Dockhorn, Arash Vahdat, Karsten Kreis
Heterogeneous-Agent Trajectory Forecasting Incorporating Class Uncertainty
Boris Ivanovic, Kuan-Hui Lee, Pavel Tokmakov, Blake Wulfe, Adrien Gaidon, Marco Pavone
AdvDO: Realistic Adversarial Attacks for Trajectory Prediction
Yulong Cao, Chaowei Xiao, Anima Anandkumar, Danfei Xu, Marco Pavone
LANA: Latency Aware Network Acceleration
Pavlo Molchanov, Jimmy Hall, Hongxu Danny Yin, Jan Kautz, Nicolo Fusi, Arash Vahdat
An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion
Rinon Gal, Yuval Alaluf, Yuval Atzmon, Or Patashnik, Amit H. Bermano, Gal Chechik, Daniel Cohen-Or
Top 25%
Instant Neural Graphics Primitives with a Multiresolution Hash Encoding
Thomas Müller, Alex Evans, Christoph Schied, Alex Keller
Best Technical Paper, SIGGRAPH 2022
THE BEST INVENTIONS OF 2022, TIME
Whose Track Is It Anyway? Improving Robustness to Tracking Errors with Affinity-Based Prediction
Xinshuo Weng, Boris Ivanovic, Kris Kitani, Marco Pavone
ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planning
Yuxiao Chen, Boris Ivanovic, Marco Pavone
Polymorphic-GAN: Generating Aligned Samples across Multiple Domains with Learned Morph Maps
Seung Wook Kim, Karsten Kreis, Daiqing Li, Antonio Torralba, Sanja Fidler
GroupViT: Semantic Segmentation Emerges from Text Supervision
Jiarui Xu, Shalini De Mello, Sifei Liu, Wonmin Byeon, Thomas Breuel, Jan Kautz, Xiaolong Wang