Publications

Our publications provide insight into some of our leading-edge research.

Filters

Filters

Publication Year

Research Areas

Events

2025

Toward Understanding Display Size for FPS Esports Aiming
Arjun Madhusudan, Josef Spjut, Benjamin Watson, Seth Schneider, Ben Boudaoud, Joohwan Kim
Pushing the Limits? Frame Rate Benefits to Players for up to 500 Hz in First Person Shooter Games
Samin Shahriar Tokey, Ben Boudaoud, Joohwan Kim, Josef Spjut, Mark Claypool
eXtended Reality and Artificial Intelligence in Medicine and Rehabilitation
Tomas Krilavičius, Lucio Tommaso De Paolis, Valerio De Luca, Josef Spjut

2024

Large Étendue 3D Holographic Display with Content-adpative Dynamic Fourier Modulation
Brian Chao, Manu Gopakumar, Suyeon Choi, Liang Shi, Jonghyun Kim, Gordon Wetzstein
SpecTrack: Learned Multi-Rotation Tracking via Speckle Imaging
Ziyang Chen, Doğa Doğan, Josef Spjut, Kaan Akşit
Honorable Mention
Variable Frame Timing Affects Perception of Smoothness in First-Person Gaming
Devi Klein, Josef Spjut, Ben Boudaoud, Joohwan Kim
On Smoothly Varying Frame Timing in First-Person Gaming
UC Santa Barbara and NVIDIA, Josef Spjut, Ben Boudaoud, Joohwan Kim
FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objects
Bowen Wen, Wei Yang, Jan Kautz, Stan Birchfield
Full-colour 3D holographic augmented-reality displays with metasurface waveguides
Manu Gopakumar, Gun-Yeal Lee, Suyeon Choi, Brian Chao, Yifan Peng, Jonghyun Kim, Gordon Wetzstein

2023

Constant Field of View Display Size Effects on First-Person Aiming Time
Josef Spjut, Ben Boudaoud, Joohwan Kim
AI-Mediated 3D Video Conferencing
Michael Stengel, Koki Nagano, Chao Liu, Matthew Chan, Alex Trevithick, Shalini De Mello, Jonghyun Kim, David Luebke, Amrita Mazumdar, Shengze Wang, Mayoore Jaiswal
Live 3D Portrait: Real-Time Radiance Fields for Single-Image Portrait View Synthesis
Alexander Trevithick, Matthew Chan, Michael Stengel, Eric R. Chan, Chao Liu, Zhiding Yu, Sameh Khamis, Manmohan Chandraker, Ravi Ramamoorthi, Koki Nagano
GazeNeRF: 3D-Aware Gaze Redirection with Neural Radiance Fields
Alessandro Ruzzi, Xiangwei Shi, Xi Wang, Gengyan Li, Shalini De Mello, Hyung Jin Chang, Xucong Zhang, Otmar Hilliges
BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects
Bowen Wen, Jonathan Tremblay, Valts Blukis, Stephen Tyree, Thomas Müller, Alex Evans, Dieter Fox, Jan Kautz, Stan Birchfield

2022

Display Size and Targeting Performance: Small Hurts, Large May Help
Joohwan Kim, Arjun Madhusudan, Benjamin Watson, Ben Boudaoud, Roland Tarrazo, Josef Spjut
Embodied Scene-aware Human Pose Estimation
Zhengyi Luo, Shun Iwase, Ye Yuan, Kris Kitani
The Esports Frontier: Rendering, Interaction and Display
Benjamin Watson, Josef Spjut, Byungjoo Lee, Greg Ward
Holographic Glasses for Virtual Reality
Jonghyun Kim, Manu Gopakumar, Suyeon Choi, Yifan Peng, Ward Lopes, Gordon Wetzstein
Time-multiplexed Neural Holography: A Flexible Framework for Holographic Near-eye Displays with Fast Heavily-quantized Spatial Light Modulators
Suyeon Choi, Manu Gopakumar, Yifan Peng, Jonghyun Kim, Matthew O'Toole, Gordon Wetzstein

2021

AdaptiBrush: Adaptive General and Predictable VR Ribbon Brush
Enrique Rosales, Chrystiano Araujo, Jafet Rodriguez, Nicholas Vining, Dongwook Yoon, Alla Sheffer
Unfiltered holography: optimizing high diffraction orders without optical filtering for compact holographic displays
Manu Gopakumar, Jonghyun Kim, Suyeon Choi, Yifan Peng, Gordon Wetzstein
Neural 3D Holography
Suyeon Choi, Manu Gopakumar, Yifan Peng, Jonghyun Kim, Gordon Wetzstein
Speckle-free holography with partially coherent light sources and camera-in-the-loop calibration
Yifan Peng, Suyeon Choi, Jonghyun Kim, Gordon Wetzstein
Enabling Next-generation Holographic Displays with Artificial Intelligence
Gordon Wetzstein, Yifan Peng, Suyeon Choi, Jonghyun Kim
A distributed, decoupled system for losslessly streaming dynamic light probes to thin clients
Michael Stengel, Zander Majercik, Ben Boudaoud, Morgan McGuire
High-quality Holographic Displays Using Double SLMs and Camera-in-the-loop Optimization
Suyeon Choi, Yifan Peng, Jonghyun Kim, Gordon Wetzstein
Optimizing Image Quality for Holographic Near-eye Displays with Michelson Holography
Suyeon Choi, Jonghyun Kim, Yifan Peng, Gordon Wetzstein

2020

Neural Holography
Yifan Peng, Suyeon Choi, Nitish Padmanaban, Jonghyun Kim, Gordon Wetzstein
Weakly-Supervised 3D Hand Pose Estimation via Biomechanical Constraints
Adrian Spurr, Umar Iqbal, Pavlo Molchanov, Otmar Hilliges, Jan Kautz
Post-Render Warp with Late Input Sampling Improves Aiming Under High Latency Conditions
Joohwan Kim, Pyarelal Knowles, Josef Spjut, Ben Boudaoud, Morgan McGuire
NRMVS: Non-Rigid Multi-view Stereo
Matthias Innmann, Kihwan Kim, Jinwei Gu, Matthias Niessner , Charles Loop, Marc Stamminger, Jan Kautz
Prescription AR: a fully-customized prescription-embedded augmented reality display
Jui-Yi Wu, Jonghyun Kim