Publications

Our publications provide insight into some of our leading-edge research.

Filters

Filters

Publication Year

Research Areas

Events

  • 107 results found

2024

Learning to Move Like Professional Counter-Strike Players
David Durst, F. Xie, V. Sarukkai, Brennan Shacklett, Iuri Frosio, Chen Tessler, Joohwan Kim, C. Taylor, G. Bernstein, S. Choudhury, P. Hanrahan,, Kayvon Fatahalian
Conformer without Convolutions
Matthijs Van keirsbilck, Alex Keller
Mitigating Covariate Shift in Imitation Learning for Autonomous Vehicles Using Latent Space Generative World Models
Alexander Popov, Alperen Degirmenci, David Wehr, Shashank Hegde , Ryan Oldja, Alexey Kamenev, Bertrand Douillard, David Nistér, Urs Muller, Ruchi Bhargava, Stan Birchfield, Nikolai Smolyanskiy
LLM Pruning and Distillation in Practice: The Minitron Approach
Sharath Turuvekere Sreenivas, Saurav Muralidharan, Raviraj Joshi, Marcin Chochowski, Mostofa Patwary, Mohammad Shoeybi, Bryan Catanzaro, Jan Kautz, Pavlo Molchanov
Kilometer-Scale Convection Allowing Model Emulation using Generative Diffusion Modeling
Jaideep Pathak, Yair Cohen, Piyush Garg, Peter Harrington, Noah Brenowitz, Dale Durran, Morteza Mardani, Arash Vahdat, Shaoming Xu, Karthik Kashinath, Mike Pritchard
VerilogCoder: Autonomous Verilog Coding Agents with Graph-based Planning and Abstract Syntax Tree (AST)-based Waveform Tracing Tool
Chia-Tung (Mark) Ho, Haoxing (Mark) Ren, Brucek Khailany
GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators
Yuchen Hu, Chen Chen, Huck Yang, Ruizhe Li, Zhehuai Chen, Eng Siong Chng
Variable Frame Timing Affects Perception of Smoothness in First-Person Gaming
Devi Klein, Josef Spjut, Ben Boudaoud, Joohwan Kim
TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models
Gilad Deutch, Rinon Gal, Daniel Garibi, Or Patashnik, Daniel Cohen-Or
Align Your Steps: Optimizing Sampling Schedules in Diffusion Models
Amirmojtaba Sabour, Sanja Fidler, Karsten Kreis
DoRA: Weight-Decomposed Low-Rank Adaptation
Shih-Yang Liu, Chien-Yi Wang, Hongxu Danny Yin, Pavlo Molchanov, Frank Wang, Kwang-Ting Cheng, Min-Hung Chen
DisCo-Diff: Enhancing Continuous Diffusion Models with Discrete Latents
Yilun Xu, Gabriele Corso, Tommi Jaakkola, Arash Vahdat, Karsten Kreis
Studying Esports Competition: Piloting Methodology for User Studies During Tournaments
Arjun Madhusudan, Josef Spjut, Ben Boudaoud, Joohwan Kim, Benjamin Watson
On Smoothly Varying Frame Timing in First-Person Gaming
UC Santa Barbara and NVIDIA, Josef Spjut, Ben Boudaoud, Joohwan Kim
RVT-2: Learning Precise Manipulation from Few Examples
Ankit Goyal, Valts Blukis, Jie Xu, Yijie Guo, Yu-Wei Chao, Dieter Fox
Breathing Life Into Sketches Using Text-to-Video Priors
Rinon Gal, Yael Vinker, Yuval Alaluf, Amit Bermano, Daniel Cohen-Or, Ariel Shamir, Gal Chechik
Experimenting with Artificial Intelligence: Programming Pathfinding Algorithms in C++ with Unreal Engine 5
Deborah Yuen, Josef Spjut
Real-Time Anomaly Detection and Reactive Planning with Large Language Models
Rohan Sinha, Amine Elhafsi, Christopher Agia, Matthew Foutter, Edward Schmerling, Marco Pavone
VMF Diffuse: A unified rough diffuse BRDF
Eugene d'Eon, Andrea Weidlich
fVDB: A Deep-Learning Framework for Sparse, Large-Scale, and High-Performance Spatial Intelligence
Francis Williams, Jiahui Huang, Jonathan Swartz, Gergely Klar, Vijay Thakkar, Matthew Cong, Xuanchi Ren, Ruilong Li, Clement Fuji-Tsang, Sanja Fidler, Eftychios Sifakis, Ken Museth
Decorrelating ReSTIR Samplers via MCMC Mutations
Rohan Sawhney, Daqi Lin, Markus Kettunen, Benedikt Bitterli, Ravi Ramamoorthi, Chris Wyman, Matt Pharr
Simplicits: Mesh-Free, Geometry-Agnostic, Elastic Simulation
Vismay Modi, Nicholas Sharp, Or Perel, Shinjiro Sueda, David I. W. Levin
SuperPADL: Scaling Language-Directed Physics-Based Control with Progressive Supervised Distillation
Modeling Hair Strands with Roving Capsules
Alexander Reshetov, David Hart
Fluid Control with Laplacian Eigenfunctions
Yixin Chen, David Levin, Timothy Langlois
Path-space Differentiable Rendering of Implicit Surfaces
Siwei Zhou, Youngha Chang, Nobuhiko Mukai, Hiroaki Santo, Fumio Okura, Yasuyuki Matsushita, Shuang Zhao
Surface-Filling Curve Flows via Implicit Medial Axes
Yuta Noma, Silvia Sellan, Nicholas Sharp, Karan Singh, Alec Jacobson
Walkin’ Robin: Walk on Stars with Robin Boundary Conditions
Bailey Miller, Rohan Sawhney, Keenan Crane, Ioannis Gkioulekas
SIGGRAPH 2024 Best Paper Award
Area ReSTIR: Resampling for Real-Time Defocus and Antialiasing
Song Zhang, Daqi Lin, Markus Kettunen, Cem Yuksel, Chris Wyman
From Microfacets to Participating Media: A Unified Theory of Light Transport with Stochastic Geometry
Dario Seyb, Eugene d'Eon, Benedikt Bitterli, Wojciech Jarosz
SIGGRAPH 2024 Best Paper Award
A Free-Space Diffraction BSDF
Shlomi Steinberg, Ravi Ramamoorthi, Benedikt Bitterli, Arshiya Mollazainali, Eugene d'Eon, Matt Pharr
Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modeling
Xiaoyu Shi, Zhaoyang Huang, Fu-Yun Wang, Weikang Bian, Dasong Li, Yi Zhang, Manyuan Zhang, Ka Chun Cheung, Simon See, Hongwei Qin, Jifeng Dai, Hongsheng Li