Publications

Our publications provide insight into some of our leading-edge research.

Filters

Filters

Publication Year

Research Areas

Events

2022

A-ViT: Adaptive Tokens for Efficient Vision Transformer
Hongxu Danny Yin, Arash Vahdat, Jose M. Alvarez, Arun Mallya, Jan Kautz, Pavlo Molchanov
When to Prune? A Policy towards Early Structural Pruning
Maying Shen, Pavlo Molchanov, Hongxu Danny Yin, Jose M. Alvarez
GradViT: Gradient Inversion of Vision Transformers
Ali Hatamizadeh , Hongxu Danny Yin, Holger Roth, Wenqi Li, Jan Kautz, Daguang Xu, Pavlo Molchanov
HandoverSim: A Simulation Framework and Benchmark for Human-to-Robot Object Handovers
Yu-Wei Chao, Chris Paxton, Yu Xiang, Wei Yang, Balakumar Sundaralingam, Tao Chen, Adithya Murali, Maya Cakmak, Dieter Fox
Propagating State Uncertainty Through Trajectory Forecasting
Boris Ivanovic, Yifeng Lin, Shubham Shrivastava, Punarjay Chakravarty, Marco Pavone
A Dataset and Explorer for 3D Signed Distance Functions
Towaki Takikawa, Andrew Glassner, Morgan McGuire
Neural Fields in Visual Computing and Beyond
Yiheng Xie, Towaki Takikawa, Shunsuke Saito, Or Litany, Shiqin Yan, Numair Khan, Federico Tombari, James Tompkin, Vincent Sitzmann, Srinath Sridhar
Learning Continuous Environment Fields via Implicit Functions
Xueting Li, Shalini De Mello, Xiaolong Wang, Ming-Hsuan Yang, Jan Kautz, Sifei Liu
Efficient Token Mixing for Transformers via Adaptive Fourier Neural Operators
"This is my unicorn, Fluffy": Personalizing frozen vision-language representations
Niv Cohen, Rinon Gal, Gal Chechik, Yuval Atzmon
Oral
Learning Contrastive Representation for Semantic Correspondence
Taihong Xiao, Sifei Liu, Shalini De Mello, Zhiding Yu, Jan Kautz, Ming-Hsuan Yang
PredictionNet: Real-Time Joint Probabilistic Traffic Prediction for Planning, Control, and Simulation
Alexey Kamenev, Lirui Wang, Ollin Boer Bohan, Ishwar Kulkarni, Bilal Kartal, Artem Molchanov, Stan Birchfield, David Nister, Nikolai Smolyanskiy
Score-Based Generative Modeling with Critically-Damped Langevin Diffusion
Tim Dockhorn, Arash Vahdat, Karsten Kreis
Tackling the Generative Learning Trilemma with Denoising Diffusion GANs
Zhisheng Xiao, Karsten Kreis, Arash Vahdat
Single-Stage Keypoint-Based Category-Level Object Pose Estimation from an RGB Image
Yunzhi Lin, Jonathan Tremblay, Stephen Tyree, Patricio A. Vela, Stan Birchfield
Keypoint-Based Category-Level Object Pose Tracking from an RGB Sequence with Uncertainty Estimation
Yunzhi Lin, Jonathan Tremblay, Stephen Tyree, Patricio A. Vela, Stan Birchfield
Displacement-Invariant Cost Computation for Efficient Stereo Matching
Yiran Zhong, Charles Loop, Wonmin Byeon, Stan Birchfield, et al.
RTMV: A Ray-Traced Multi-View Synthetic Dataset for Novel View Synthesis
Jonathan Tremblay, Moustafa Meshry, Stan Birchfield, Alex Evans, Jan Kautz, Alex Keller, Sameh Khamis, Charles Loop, Nate Morrical, Thomas Müller, Koki Nagano, Towaki Takikawa, Stan Birchfield

2021

EditGAN: High-Precision Semantic Image Editing
Huan Ling, Karsten Kreis, Daiqing Li, Seung Wook Kim, Antonio Torralba, Sanja Fidler
KAMA: 3D Keypoint Aware Body Mesh Articulation
Umar Iqbal, Kevin Xie, Kelly Guo, Jan Kautz, Pavlo Molchanov
Standard vs. Learning-based Codecs for Real Time Endoscopic Video Transmission
Iuri Frosio, Aldo Marzullo, Martina Golini, Elena De Momi, Michele Catellani, Francesco Calimeri, Giuseppe Fiameni
Extracting Triangular 3D Models, Materials, and Lighting From Images
Jacob Munkberg, Jon Hasselgren, Tianchang Shen, Jun Gao, Wenzheng Chen, Alex Evans, Thomas Müller, Sanja Fidler
Noise-Aware Video Saliency Prediction
Ekta Prashnani, Orazio Gallo, Joohwan Kim, Josef Spjut, Pradeep Sen, Iuri Frosio
A Contrastive Learning Approach for Training Variational Autoencoder Priors
Jyoti Aneja, Alexander Schwing, Jan Kautz, Arash Vahdat
Controllable and Compositional Generation with Latent-Space Energy-Based Models
Weili Nie, Arash Vahdat, Anima Anandkumar
Don’t Generate Me: Training Differentially Private Generative Models with Sinkhorn Divergence
Tianshi Cao, Alex Bie, Arash Vahdat, Sanja Fidler, Karsten Kreis
Score-based Generative Modeling in Latent Space
Arash Vahdat, Karsten Kreis, Jan Kautz
MTP: Multi-Hypothesis Tracking and Prediction for Reduced Error Propagation
Xinshuo Weng, Boris Ivanovic, Marco Pavone
Self-Supervised Object Detection via Generative Image Synthesis
Siva Karthik Mustikovela, Shalini De Mello, Aayush Prakash, Umar Iqbal, Sifei Liu, Thu Nguyen-Phuoc, Carsten Rother, Jan Kautz
Self-Supervised Real-to-Sim Scene Generation
Aayush Prakash, Shoubhik Debnath, Jean-Francois Lafleche, Eric Cameracci, Gavriel State, Stan Birchfield, Marc T. Law
Multi-View Fusion for Multi-Level Robotic Scene Understanding
Yunzhi Lin, Jonathan Tremblay, Stephen Tyree, Patricio A. Vela, Stan Birchfield
Weakly-Supervised Physically Unconstrained Gaze Estimation
Rakshit Kothari, Shalini De Mello, Umar Iqbal, Wonmin Byeon, Seonwook Park, Jan Kautz
Oral