Publications (67)

2026

3D-GENERALIST: Vision-Language-Action Models for Crafting 3D Worlds

Fan-Yun Sun (Stanford University), Shengguang Wu (Stanford University), Christian Jacobsen (NVIDIA), Thomas Yim (Stanford University), Haoming Zou (Stanford University), Alex Zook , Shangru Li (NVIDIA), Yu-Hsin Chou (Stanford University), Ethem Can (NVIDIA), Xunlei Wu (NVIDIA), Clemens Eppner (NVIDIA), Valts Blukis , Jonathan Tremblay , Jiajun Wu (Stanford University), Stan Birchfield , Nick Haber (Stanford University)

International Conference on 3D Vision 2026 - 20 Mar 2026

2025

Seeing What Matters: Generalizable AI-generated Video Detection with Forensic-Oriented Augmentation

Riccardo Corvi (University Federico II of Naple), Davide Cozzolino (University Federico II of Naple), Ekta Prashnani , Shalini De Mello , Koki Nagano , Luisa Verdoliva (University Federico II of Naple)

Advances in Neural Information Processing Systems (NeurIPS) 2025 - 30 Nov 2025

Pedestrian Collision Avoidance in Hemianopia during Natural Walking in Immersive Virtual Reality

Jonathan K. Doyon (Harvard Medical School), Sujin Kim (Harvard Medical School), Alex D. Hwang (Harvard Medical School), Jae-Hyun Jung

arXiv - 6 Oct 2025

Assessing Learned Models for Phase-only Hologram Compression

Zicong Peng (University College London), Yicheng Zhan (University College London), Josef Spjut , Kaan Akşit (University College London)

SIGGRAPH 2025 Posters - 10 Aug 2025

Esports Rendering: Industry and Player Perspectives

Josef Spjut , Benjamin Watson (North Carolina State University)

SIGGRAPH 2025 Frontiers - 10 Aug 2025

Fly, Fail, Fix: Iterative Game Repair with Reinforcement Learning and Large Multimodal Models

Alex Zook , Josef Spjut , Jonathan Tremblay

Reinforcement Learning and Video Games Workshop @ RLC 2025 - 5 Aug 2025

A Generative AI Game Jam Case Study from October 2024

Josef Spjut

CVPR 2025 Workshop on Computer Vision For Videogames (CV2) - 11 Jun 2025

GRS: Generating robotic simulation tasks from real-world images

Alex Zook , Josef Spjut , Jonathan Tremblay

CVPR 2025 - 11 Jun 2025

Detection of artifacts in clean and corrupted video pairs is influenced by artifact type and presentation modality

Niall L. Williams (New York University), Anatolii Evdokimov (New York University), Budmonde Duinkharjav (New York University), Anjul Patney (NVIDIA), Qi Sun (New York University), Jae-Hyun Jung , Ruth Rosenholtz

Vision Science Society - 18 May 2025

Modeling Visually-Guided Aim-and-Shoot behavior in First-Person Shoters

June-Seop Yoon (Yonsei University), Hee-Seung Moon (Chung-Ang University), Ben Boudaoud , Josef Spjut , Iuri Frosio , Byungjoo Lee (Yonsei University), Joohwan Kim

International Journal of Human-Computer Studies - 4 Apr 2025

Toward Understanding Display Size for FPS Esports Aiming

Arjun Madhusudan (North Carolina State University and NVIDIA), Josef Spjut , Benjamin Watson (North Carolina State University), Seth Schneider (NVIDIA), Ben Boudaoud , Joohwan Kim

Foundations of Digital Games - 15 Apr 2025

Pushing the Limits? Frame Rate Benefits to Players for up to 500 Hz in First Person Shooter Games

Samin Shahriar Tokey (Worcester Polytechnic Institute), Ben Boudaoud , Joohwan Kim , Josef Spjut , Mark Claypool (Worcester Polytechnic Institutute)

Network and Operating System Support for Digital Audio and Video - 30 Mar 2025

eXtended Reality and Artificial Intelligence in Medicine and Rehabilitation

Tomas Krilavičius (University of Salento), Lucio Tommaso De Paolis (Vytautas Magnus University), Valerio De Luca (University of Salento), Josef Spjut

Information Systems Frontiers - 29 Jan 2025

2024

FactorSim: Generative Simulation via Factorized Representation

Fan-Yun Sun (Stanford University), S. I. Harini (Stanford University), Angela Yi (Stanford University), Yihan Zhou (Stanford University), Alex Zook , Jonathan Tremblay , Logan Cross (Stanford University), Jiajun Wu (Stanford University), Nick Haber (Stanford University)

NeurIPS 2024 - 10 Dec 2024

SpecTrack: Learned Multi-Rotation Tracking via Speckle Imaging

Ziyang Chen (University College London), Doğa Doğan (Adobe Research), Josef Spjut , Kaan Akşit (University College London)

SIGGRAPH Asia Posters - 2 Dec 2024

Avatar Fingerprinting for Authorized Use of Synthetic Talking-Head Videos

Ekta Prashnani , Koki Nagano , Shalini De Mello , David Luebke , Orazio Gallo (NVIDIA)

European Conference on Computer Vision (ECCV) 2024 - 29 Sep 2024

Learning to Move Like Professional Counter-Strike Players

David Durst (Stanford), F. Xie (Activision Blizzard), V. Sarukkai (Stanford), Brennan Shacklett (Stanford), Iuri Frosio , Chen Tessler , Joohwan Kim , C. Taylor (Activision Blizzard), G. Bernstein (University of Washington), S. Choudhury (Cornell), P. Hanrahan, (Stanford), Kayvon Fatahalian (Stanford)

The 23rd ACM SIGGRAPH / Eurographics Symposium on Computer Animation (SCA 2024) - 18 Sep 2024

Variable Frame Timing Affects Perception of Smoothness in First-Person Gaming

Devi Klein (NVIDIA and UC Santa Barbara), Josef Spjut , Ben Boudaoud , Joohwan Kim

IEEE Conference on Games (CoG) - 5 Aug 2024

Experimenting with Artificial Intelligence: Programming Pathfinding Algorithms in C++ with Unreal Engine 5

Deborah Yuen (University of Southern California), Josef Spjut

ACM SIGGRAPH Labs - 13 Jul 2024

On Smoothly Varying Frame Timing in First-Person Gaming

UC Santa Barbara and NVIDIA (Devi Klein), Josef Spjut , Ben Boudaoud , Joohwan Kim

ACM SIGGRAPH Talks - 18 Jul 2024

Studying Esports Competition: Piloting Methodology for User Studies During Tournaments

Arjun Madhusudan (NC State University and NVIDIA), Josef Spjut , Ben Boudaoud , Joohwan Kim , Benjamin Watson (NC State University)

ACM SIGGRAPH Talks - 18 Jul 2024

Do Action Video Game Players Search Faster Than Non-Players?

Zoe (Jing) Xu (University of Illinois, Urbana Champaign), Josef Spjut , Ben Boudaoud , Simona Buetti (University of Illinois, Urbana Champaign), Alejandro Lleras (University of Illinois, Urbana Champaign), Ruth Rosenholtz

Vision Sciences Society - 18 May 2024

The Effects of Network Latency on the Peeker's Advantage in First-person Shooter Games

Samin Shahriar Tokey (Worcester Polytechnic Institute), Zesheng Chen (Worcester Polytechnic Institute), Colin Mettler (Worcester Polytechnic Institute), Dexuan Tang (Worcester Polytechnic Institute), Ben Boudaoud , Joohwan Kim , Josef Spjut , Mark Claypool (Worcester Polytechnic Institute)

Foundations of Digital Games - 21 May 2024

Is Less More? Rendering for Esports

Benjamin Watson (North Carolina State University), Josef Spjut , Joohwan Kim , Byungjoo Lee (Yonsei University), Mijin Yoo (Yonsei University), Peter Shirley (Activision), Rulon Raymond (Infinity Ward)

IEEE Computer Graphics and Applications - 27 Mar 2024

Interactive Texture Painting with Generative AI

Anita Hu (NVIDIA), Nishkrit Desai (NVIDIA), Ashley Goldstein (NVIDIA), Hassan Abu Alhaija (NVIDIA), Seung Wook Kim (NVIDIA), Daniela Hasenbring (NVIDIA), Alex Zook , Rajeev Rao (NVIDIA), Maria Shugrina (NVIDIA)

SIGGRAPH Asia 2023 - 17 Jan 2024

2023

Constant Field of View Display Size Effects on First-Person Aiming Time

Josef Spjut , Ben Boudaoud , Joohwan Kim

Frontiers in Optics 2023 - 9 Oct 2023

Less is More: Rendering for Esports

Benjamin Watson (North Carolina State University), Joohwan Kim , Josef Spjut , Peter Shirley (Activision), Byungjoo Lee (Yonsei University)

SIGGRAPH Frontiers Workshop - 7 Aug 2023

Rethinking Display Requirements for Esports and High Interactivity Applications

Joohwan Kim , Josef Spjut , Ben Boudaoud , Benjamin Watson (NCSU), Turner Whitted

SID - 30 Aug 2023

Interactive AI Material Generation and Editing in NVIDIA Omniverse

Hassan Abu Alhaija (NVIDIA), Alex Zook , Michael Babcock (NVIDIA), James Lucas (NVIDIA), David Tyner (NVIDIA), Rajeev Rao (NVIDIA), Maria Shugrina (NVIDIA)

SIGGRAPH 2023 - 23 Jul 2023

Mouse Sensitivity in First-person Targeting Tasks

Ben Boudaoud , Josef Spjut , Joohwan Kim

IEEE Transactions on Games - 17 Jul 2023

Efficient Dataflow Modeling of Peripheral Encoding in the Human Visual System

Rachel Brown (NVIDIA), Vasha DuTell (UC Berkeley), Bruce Walter (Cornell University), Ruth Rosenholtz , Peter Shirley (NVIDIA), Morgan McGuire (NVIDIA), David Luebke

ACM Transactions on Applied Perception - 11 Jan 2023

2022

Display Size and Targeting Performance: Small Hurts, Large May Help

Joohwan Kim , Arjun Madhusudan (NCSU), Benjamin Watson (NCSU), Ben Boudaoud , Roland Tarrazo (NVIDIA), Josef Spjut

SIGGRAPH Asia 2022 - 6 Dec 2022

Esports and expertise: what competitive gaming can teach us about mastery

Ben Boudaoud , Josef Spjut , Joohwan Kim , Arjun Madhusudan (NCSU), Benjamin Watson (NCSU)

ACM Interactions - 3 Nov 2022

FirstPersonScience: An Open Source Tool for Studying FPS Esports Aiming

Ben Boudaoud , Josef Spjut , Pyarelal Knowles (NVIDIA), Arjun Madhusudan (NVIDIA and NCSU), Joohwan Kim

SIGGRAPH Talks - 8 Aug 2022

Mouse Sensitivity in First-person Targeting Tasks

Ben Boudaoud , Josef Spjut , Joohwan Kim

IEEE Conference on Games - 21 Aug 2022

The Esports Frontier: Rendering, Interaction and Display

Benjamin Watson (North Carolina State University), Josef Spjut , Byungjoo Lee (Yonsei University), Greg Ward (Dolby Laboratories)

SIGGRAPH Frontiers Workshop - 10 Aug 2022

Esports meets human-computer interaction

Simone Kriglstein (Masaryk University, Austrian Institute of Technology , and University of Vienna), Anna Lisa Martin-Niedecken (Zurich University of the Arts), Josef Spjut , Nicole B. Damen (University of Nebraska at Omaha), Selen Turkay (Queensland University of Technology, Brisbane), Anders Drachen (University of Southern Denmark)

ACM Interactions - 2 May 2022

2021

Noise-Aware Video Saliency Prediction

Ekta Prashnani , Orazio Gallo (NVIDIA), Joohwan Kim , Josef Spjut , Pradeep Sen, Iuri Frosio

The British Machine Vision Conference (BMVC) - 2021 - 22 Nov 2021

Gaming at Warp Speed: Improving Aiming with Late Warp

Ben Boudaoud , Pyarelal Knowles (NVIDIA), Joohwan Kim , Josef Spjut

SIGGRAPH Emerging Technologies - 9 Aug 2021

A distributed, decoupled system for losslessly streaming dynamic light probes to thin clients

Michael Stengel , Zander Majercik (NVIDIA), Ben Boudaoud , Morgan McGuire (NVIDIA)

ACM Multimedia Systems Conference - 15 Jul 2021

A Case Study of First Person Aiming at Low Latency for Esports

Josef Spjut , Ben Boudaoud , Joohwan Kim

Esports and High Performance HCI Workshop - 8 May 2021

Scaling Probe-Based Real-Time Dynamic Global Illumination for Production

Zander Majercik (NVIDIA), Adam Marrs (NVIDIA), Josef Spjut , Morgan McGuire (NVIDIA)

The Journal of Computer Graphics Techniques - 3 May 2021

Robust Vision-Based Cheat Detection in Competitive Gaming

Aditya Jonnalagadda (University of California, Santa Barbara), Iuri Frosio , Seth Schenider (NVIDIA), Morgan McGuire (NVIDIA), Joohwan Kim

I3D ’21 - 24 Mar 2021

2020

Scaling Probe-Based Real-Time Dynamic Global Illumination for Production (Technical Report)

Zander Majercik (NVIDIA), Adam Marrs (NVIDIA), Josef Spjut , Morgan McGuire (NVIDIA)

arXiv.org - 22 Sep 2020

Post-Render Warp with Late Input Sampling Improves Aiming Under High Latency Conditions

Joohwan Kim , Pyarelal Knowles (NVIDIA), Josef Spjut , Ben Boudaoud , Morgan McGuire (NVIDIA)

High Performance Graphics 2020 - 13 Jul 2020

Eccentricity Effects on Blur and Depth Perception

Qi Sun (Adobe Research), Fu-Chung Huang (NVIDIA), Li-Yi Wei (Adobe Research), David Luebke , Arie Kaufman (Department of Computer Science, Stony Brook University), Joohwan Kim

Optics Express - 21 Feb 2020

Toward Standardized Classification of Foveated Displays

Josef Spjut , Ben Boudaoud , Jonghyun Kim , Trey Greer , Rachel Albert (NVIDIA), Michael Stengel , Kaan Akşit (NVIDIA), David Luebke

IEEE Transactions on Visualization and Computer Graphics “Presented at IEEE VR … - 14 Feb 2020

2019

Latency of 30 ms Benefits First Person Targeting Tasks More Than Refresh Rate Above 60 Hz

Josef Spjut , Ben Boudaoud , Kamran Binaee (NVIDIA and RIT), Jonghyun Kim , Zander Majercik (NVIDIA), Morgan McGuire (NVIDIA), David Luebke , Joohwan Kim

Siggraph Asia Technical Briefs - 17 Nov 2019

FirstPersonScience: Quantifying Psychophysics for First Person Shooter Tasks

Josef Spjut , Ben Boudaoud , Kamran Binaee (Rochester Institute of Technology), Zander Majercik (NVIDIA), Morgan McGuire (NVIDIA), Joohwan Kim

UCI Esports Conference - 10 Oct 2019

Esports Arms Race: Latency and Refresh Rate for Competitive Gaming Tasks

Joohwan Kim , Josef Spjut , Morgan McGuire (NVIDIA), Zander Majercik (NVIDIA), Ben Boudaoud , Rachel Albert (NVIDIA), David Luebke

Journal of Vision - 6 Sep 2019

Temporally Dense Ray Tracing

Pontus Ebelin , Jim Nilsson (NVIDIA), Marco Salvi , Josef Spjut , Tomas Akenine-Möller

High Performance Graphics 2019 - 8 Jul 2019

Foveated AR: Dynamically-Foveated Augmented Reality Display

Jonghyun Kim , Youngmo Jeong (NVIDIA, Seoul National University), Michael Stengel , Kaan Akşit (NVIDIA), Rachel Albert (NVIDIA), Ben Boudaoud , Trey Greer , Joohwan Kim , Ward Lopes , Zander Majercik (NVIDIA), Peter Shirley (NVIDIA), Josef Spjut , Morgan McGuire (NVIDIA), David Luebke

SIGGRAPH 2019 Technical Paper - 28 Jul 2019

Matching Prescription & Visual Acuity: Towards AR for Humans

Jonghyun Kim , Michael Stengel , Jui-Yi Wu (NVIDIA, National Chiao Tung University), Ben Boudaoud , Josef Spjut , Kaan Akşit (NVIDIA), Rachel Albert (NVIDIA), Youngmo Jeong (NVIDIA, Seoul National University), Trey Greer , Ward Lopes , Zander Majercik (NVIDIA), Peter Shirley (NVIDIA), Morgan McGuire (NVIDIA), David Luebke

SIGGRAPH 2019 Emerging Technology - 28 Jul 2019

SIDOD: A Synthetic Image Dataset for 3D Object Pose Recognition with Distractors

Mona Jalal (Boston University, NVIDIA), Josef Spjut , Ben Boudaoud , Margrit Betke (Boston University)

WiCV - 16 Jun 2019

NVGaze: An Anatomically-Informed Dataset for Low-Latency, Near-Eye Gaze Estimation

Joohwan Kim , Michael Stengel , Alexander Majercik (NVIDIA), Shalini De Mello , David Dunn (UNC), Samuli Laine , Morgan McGuire (NVIDIA), David Luebke

ACM Conference on Human-Computer-Interaction (CHI) 2019 - 4 May 2019

Improving Temporal Antialiasing with Adaptive Ray Tracing

Adam Marrs (NVIDIA), Josef Spjut , Holger Gruen (NVIDIA), Rahul Sathe (NVIDIA), Morgan McGuire (NVIDIA)

Ray Tracing Gems - 18 Mar 2019

2018

Fluidic Elastomer Actuators for Haptic Interactions in Virtual Reality

Jose Barreiros (Cornell University), Houston Claure (Cornell University), Bryan Peele (Cornell University and NVIDIA), Omer Shapira , Josef Spjut , David Luebke , Malte Jung (Cornell University), Robert Shepherd (Cornell University)

IEEE Robotics and Automation Letters - 19 Dec 2018

Adaptive Temporal Antialiasing

Adam Marrs (NVIDIA), Josef Spjut , Holger Gruen (NVIDIA), Rahul Sathe (NVIDIA), Morgan McGuire (NVIDIA)

High Performance Graphics - 10 Aug 2018

Steerable application-adaptive near eye displays

Kishore Rathinavel (UNC), Praneeth Chakravarthula (UNC), Kaan Akşit (NVIDIA), Josef Spjut , Ben Boudaoud , Turner Whitted (NVIDIA), David Luebke , Henry Fuchs (UNC)

Proceeding SIGGRAPH '18 ACM SIGGRAPH 2018 Emerging Technologies - 12 Aug 2018

A Variable Shape and Variable Stiffness Controller for Haptic Virtual Interactions

Benjamin C. Mac Murray (Cornell University), Bryan N. Peele (Cornell University), Patricia Xu (Cornell University), Josef Spjut , Omer Shapira , David Luebke , Robert F. Shepherd (Cornell University)

RoboSoft - 24 Apr 2018

2017

Perceptually-Guided Foveation for Light Field Displays

Qi Sun (Stony Brook University & NVIDIA), Fu-Chung Huang (NVIDIA), Joohwan Kim , Li-Yi Wei (University of Hong Kong), David Luebke , Arie Kaufman (Stony Brook University)

ACM SIGGRAPH ASIA 2017 - 27 Nov 2017

Latency Requirements for Foveated Rendering in Virtual Reality

Rachel Albert (UC Berkeley, NVIDIA), Anjul Patney (NVIDIA), David Luebke , Joohwan Kim

ACM Transactions on Applied Perception (TAP) - Special Issue SAP 2017 - 18 Sep 2017

Stretchable Transducers for Kinesthetic Interactions in Virtual Reality

Robert Shepherd (Cornell University), Bryan Peele (Cornell University), Benjamin Mac Murray (Cornell University), Jose Barreiros (Cornell University), Omer Shapira , Josef Spjut , David Luebke

SIGGRAPH Emerging Technologies - 30 Jul 2017

Varifocal Virtuality: A Novel Optical Layout for Near-Eye Display

Kaan Akşit (NVIDIA), Ward Lopes , Jonghyun Kim , Josef Spjut , Peter Shirley (NVIDIA), David Luebke

ACM Siggraph Emerging Technologies - 31 Jul 2017

2016

Towards Foveated Rendering for Gaze-Tracked Virtual Reality

Anjul Patney (NVIDIA), Marco Salvi , Joohwan Kim , Anton Kaplanyan (NVIDIA), Chris Wyman , Nir Benty (NVIDIA), David Luebke , Aaron Lefohn

ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia) - 5 Dec 2016

Perceptually-Based Foveated Virtual Reality

Anjul Patney (NVIDIA), Joohwan Kim , Marco Salvi , Anton Kaplanyan (NVIDIA), Chris Wyman , Nir Benty (NVIDIA), Aaron Lefohn , David Luebke

SIGGRAPH Emerging Technologies - 1 Jul 2016

Hybrid Modulation for Near Zero Display Latency

Trey Greer , Josef Spjut , David Luebke , Turner Whitted (NVIDIA)

SID - 1 May 2016

Human Performance and Experience Research Group

NVIDIA Research

Human Performance and Experience Research Group

Demos & Tools (3)

Publications (67)