Publications

Our publications provide insight into some of our leading-edge research.

Filters

Filters

Publication Year

Research Areas

Events

2026

Agent Explorative Policy Optimization for Multimodal Agentic Reasoning
Minki Kang, Shizhe, Ryo Hachiuma, Sung Ju Hwang, Pavlo Molchanov, Yu-Chiang Frank Wang, Byung-Kwan Lee
SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning
Seokju Cho, Ryo Hachiuma, Abhishek Badki, Hang Su, Byung-Kwan Lee, Chan Hee Song, Sifei Liu, Subhashree Radhakrishnan, Seungryong Kim, Yu-Chiang Frank Wang, Min-Hung Chen
Hide to See: Reasoning-prefix Masking for Visual-anchored Thinking in VLM Distillation
Seonghoon Yu, Dongjun Nam, Byung-Kwan Lee, Jeany Son
Zone of Proximal Policy Optimization: Teacher in Prompts, Not Gradients
Byung-Kwan Lee, Ximing Lu, Shizhe Diao, Minki Kang, Saurav Muralidharan, Karan Sapra, Andrew Tao, Pavlo Molchanov, Yejin Choi, Frank Wang, Ryo Hachiuma
GenRecal: Generation after Recalibration from Large to Small Vision-Language Models
Byung-Kwan Lee, Ryo Hachiuma, Yong Man Ro, Yu-Chiang Frank Wang, Yueh-Hua Wu
Why and When Visual Token Pruning Fails? A Study on Relevant Visual Information Shift in MLLMs Decoding
Jiwan Kim, Kibum Kim, Wonjoong Kim, Byung-Kwan Lee, Chanyoung Park
Adaptive Time Delay for Improving Player Experience and Fairness in First-Person Shooter Games with Network Latency
Samin Shahriar Tokey, Ben Boudaoud, Josef Spjut, Mark Claypool
Impact of Frametime Spikes on Performance and Quality of Experience in Platformer Games
Samin Shahriar Tokey, Ben Boudaoud, Josef Spjut, Mark Claypool
Addressable Memory for Video World Models
Xindi Wu, Sven Elflein, James Lucas, Olga Russakovsky, Laura Leal-Taixé, Despoina Paschalidou, Jonathan Lorraine, Aljoša Ošep
Best Paper, Oral — ICML 2026 F2S Workshop
Effects of Frame Rates up to 500 Hz on First Person Shooter Game Players
Samin Shahriar Tokey, Ben Boudaoud, Joohwan Kim, Josef Spjut, Mark Claypool
Spatial-IQ: Deconstructing Spatial Intelligence via Hierarchical Capability Tests
Patrick Rim, Tom Long, Ekta Prashnani, Ruth Rosenholtz, Ben Boudaoud, Peter Xenopoulos, Alex Wong, Joohwan Kim, Jae-Hyun Jung
GalaxyDiT: Efficient Video Generation with Guidance Alignment and Adaptive Proxy in Diffusion Transformers
Zoey Song, Steve Dai, Ben Keller, Brucek Khailany
Performance, Rendering, and Interaction in Competitive Esports (PRICE)
Josef Spjut, Benjamin Watson, Madison Klarkowski, Rulon Raymond, Mark Claypool, Paul Ritaldato
Autonomous Discovery of Wireless Communications Algorithms
Fayçal Aït Aoudia , Jakob Hoydis, Sebastian Cammerer, Gian Marti, Merlin Nimier-David, Nicolas Roussel, Alex Keller
CTRL-G: Controllable Generative Graphics for Games
Josef Spjut, Arnav Jhala, Anjul Patney, Michael Lentine, Monde Duinkharjav
Understanding Emergent Non-Verbal Communication in the Delta Force Competitive Video Game through Multimodal AI Analysis
Jinyuan Guo, Josef Spjut
Clustered Codebook Quantization for 2D Gaussian-based Image Compression
Runze Cheng, Yicheng Zhan, Josef Spjut, Kaan Akşit
Towards Field Experiments in Esports Competition
Arjun Madhusudan, Josef Spjut, Ben Boudaoud, Joohwan Kim, Benjamin Watson
Real-time 3D Visualization of Radiance Fields on Light Field Displays
Jonghyun Kim, Cheng Sun, Michael Stengel, Matthew Chan, Andrew Russell, Jae-Hyun Jung, Wil Braithwaite, Shalini De Mello, David Luebke
Fast and accurate AI-based pre-decoders for color codes
Jan Olle, Christopher Chamberland, Muyuan Li, Igor Baratta
ROSA: A Robotics Foundation Model Serving System for Robot Factories
Wenqi Jiang, Jason Clemons, Rowland O'Flaherty, Hugo Hadfield, Alperen Degirmenci, Shuran Song, Yashraj Narang, Christos Kozyrakis
The 2M Multiplication Algorithm for Complex Matrices
Peter Caday
Mixed-Precision SVD on GPUs via Ogita–Aishima Iterative Refinement
Angelika Schwarz, Rasmus Munk Larsen, Samuel Rodriguez, Christopher Baker, Lev Kruglyak
Pedestrian Collision Detection and Avoidance in Cerebral Visual Impairment During Unrestricted Walking in an Immersive Virtual Reality Environment
Jonathan Doyon, Madeleine Heynan, Wei Hay Lew, Alex D. Hwang, Jae-Hyun Jung, Lotfi B. Merabet
Fearless Concurrency on the GPU
Melih Elibol, Jared Roesch, Isaac Gelado, Eric Buehler, Michael Garland
SuperCollider: Scalable and Effective Data Race Detection for CUDA
Mark Stephenson, Sana Damani, Mohamed Tarek Ibn Ziad, Anis Ladram, Michael Garland
Editing Physiological Signals in Videos Using Latent Representations
Tianwen Zhou, Akshay Paruchuri, Josef Spjut, Kaan Akşit
Masking Teacher and Reinforcing Student for Distilling Vision-Language Models
Byung-Kwan Lee, Yu-Chiang Frank Wang, Ryo Hachiuma
NVIDIA OmniDreams: Real-Time Generative World Model for Closed-Loop Autonomous Vehicle Simulation
Aarti Basant, Amlan Kar, Despoina Paschalidou, Fangyin Wei, Francesco Ferroni, Guillermo Garcia Cobo, Haithem Turki, Huan Ling, Jaewoo Seo, James Lucas, Jay Zhangjie Wu, Jialiang Wang, Jonathan Lorraine, Jun Gao, Kai He, Katarina Tothova, Kevin Xie, Michał Tyszkiewicz, Qi Wu, Riccardo de Lutio, Ruilong Li, Sanja Fidler, Seung Wook Kim, Tianchang Shen, Tianshi Cao, Tobias Pfaff, William Lew, Xindi Wu, Xuanchi Ren, Yifan Lu, Yuxuan Zhang, Zan Gojcic, Zian Wang
ScheduleStream: Temporal Planning with Samplers for GPU-Accelerated Multi-Arm Task and Motion Planning & Scheduling
Caelan Garrett, Fabio Ramos
Monitor refresh rate impacts FPS video gamers' perceptions of display ‘smoothness’ and target acquisition performance
Adam J. Toth, Joohwan Kim, Josef Spjut, Ben Boudaoud, Sophie Cunneen, Mark J. Campbell
HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planning
Kevin Lin, Ajay Mandlekar, Caelan Garrett, Nikita Cherniadev, Yu Fang, Runyu Ding, Yuqi Xie, Justin Tran, Linxi "Jim" Fan, Yuke Zhu
Best Workshop Paper Finalist