Publications

Our publications provide insight into some of our leading-edge research.

Filters

Filters

Publication Year

Research Areas

Events

2026

Imitation Learning of Avoidance Modes for Efficient Multimodal Model Predictive Control
Changyu Lee, Byung-Kwan Lee, Kanghoon Yoon
Mid-Harness: Scaling Actions Between Model and Harness for Terminal Agents
Minki Kang, Ryo Hachiuma, Shaokun Zhang, Subhashree Radhakrishnan, Yonggan Fu, Jindong Jiang, Mingjie Liu, Ehsan Hosseini-Asl, Yi Dong, Yu-Chiang Frank Wang, Byung-Kwan Lee
Gated DeltaNet-2: Decoupling Erase and Write in Linear Attention
Ali Hatamizadeh, Yejin Choi, Jan Kautz
DiLaDiff: Distilled Latent-Augmented Diffusion for Language Modeling
Jean-Marie Lemercier, Tomas Geffner, Morteza Mardani, Karsten Kreis, Arash Vahdat, Ante Jukic
Zone of Proximal Policy Optimization: Teacher in Prompts, Not Gradients
Byung-Kwan Lee, Ximing Lu, Shizhe Diao, Minki Kang, Saurav Muralidharan, Karan Sapra, Andrew Tao, Frank Wang, Ryo Hachiuma
When Do We Need On-Policy Distillation? Distilling on Offline Student Rollouts Is Often Better
Siyan Zhao, Yonggan Fu, Jindong Jiang, Shih-Yang Liu, Song Bian, Byung-Kwan Lee, Sharath Turuvekere Sreenivas, Wenliang Dai, Hanrong Ye, Aditya Grover, Pavlo Molchanov
EdgeWise: Bringing Long-Horizon Agents to the Edge via Selective Cloud Delegation
Zeru Shi, Jindong Jiang, Ryo Hachiuma, Yonggan Fu, Byung-Kwan Lee, Peter Belcak, Saurav Muralidharan, Ayush Agarwal, Ruixiang Tang, Ambrish Dantrey, Pavlo Molchanov, Anjul Patney, Subhashree Radhakrishnan
Test-time scaling of diffusions with flow maps
Amirmojtaba Sabour, Michael S. Albergo, Carles Domingo-Enrich, Nicholas M. Boffi, Sanja Fidler, Karsten Kreis, Eric Vanden-Eijnden
Agent Explorative Policy Optimization for Multimodal Agentic Reasoning
Minki Kang, Shizhe Diao, Ryo Hachiuma, Sung Ju Hwang, Pavlo Molchanov, Yu-Chiang Frank Wang, Byung-Kwan Lee
SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning
Seokju Cho, Ryo Hachiuma, Abhishek Badki, Hang Su, Byung-Kwan Lee, Chan Hee Song, Sifei Liu, Subhashree Radhakrishnan, Seungryong Kim, Yu-Chiang Frank Wang, Min-Hung Chen
Hide to See: Reasoning-prefix Masking for Visual-anchored Thinking in VLM Distillation
Seonghoon Yu, Dongjun Nam, Byung-Kwan Lee, Jeany Son
TAMPAgent: Agentic Belief-Space Planning for Mobile Manipulation
Utkarsh Aashu Mishra, Alperen Degirmenci, Yongxin Chen, Danfei Xu, Tucker Hermans, Caelan Garrett
DemoStream: Batched Task-and-Motion-Plan Optimization for Automated Learning from Demonstration
Caelan Garrett, Neel Jawale, Fabio Ramos
ScheduleGen: Demonstration Generation via Skill Scheduling for Multi-Arm Imitation Learning
Neel Jawale, Stephan Pleines, Soha Pouya, Yuke Zhu, Ajay Mandlekar, Caelan Garrett
Human2Any: Human-to-Robot Transfer via Constraint-Aware Compositional Planning
Shuo Cheng, Chuye Zhang, Alfred Cueva, Caelan Garrett, Ajay Mandlekar, Danfei Xu
Isekai3D SDG: A Platform for Diverse Synthetic Gameplay Visual Data
Rafał Karp, Gene Liu, Shih-Hsin Li, Eric Courtemanche, Shengze Wang, Josef Spjut, David Pankratz, Mischa Kolbe, Michael Stengel, Sven Elflein, Adam Grygielski, Liwen Wu, Anjul Patney
GenRecal: Generation after Recalibration from Large to Small Vision-Language Models
Byung-Kwan Lee, Ryo Hachiuma, Yong Man Ro, Yu-Chiang Frank Wang, Yueh-Hua Wu
Why and When Visual Token Pruning Fails? A Study on Relevant Visual Information Shift in MLLMs Decoding
Jiwan Kim, Kibum Kim, Wonjoong Kim, Byung-Kwan Lee, Chanyoung Park
HorizonRelight: Relighting Long-horizon Videos Consistently via Diffusion Transformers
Jing Yang, Mayoore Jaiswal, Zian Wang, Xiao Steven Zeng, Yajie Zhao, Rochelle Pereira, Jianyuan Min
FusionRelight: Relighting Portraits in Real Time via Hybrid Domain Knowledge Fusion
Qian Huang, Mayoore Selvarasa Jaiswal, Zhen Zhong, Rochelle Pereira, Jianyuan Min
Addressable Memory for Video World Models
Xindi Wu, Sven Elflein, James Lucas, Olga Russakovsky, Laura Leal-Taixé, Despoina Paschalidou, Jonathan Lorraine, Aljoša Ošep
Best Paper, Oral F2S Workshop
Spatial-IQ: Deconstructing Spatial Intelligence via Hierarchical Capability Tests
Patrick Rim, Tom Long, Ekta Prashnani, Ruth Rosenholtz, Ben Boudaoud, Peter Xenopoulos, Alex Wong, Joohwan Kim, Jae-Hyun Jung
GalaxyDiT: Efficient Video Generation with Guidance Alignment and Adaptive Proxy in Diffusion Transformers
Zoey Song, Steve Dai, Ben Keller, Brucek Khailany
Autonomous Discovery of Wireless Communications Algorithms
Fayçal Aït Aoudia , Jakob Hoydis, Sebastian Cammerer, Gian Marti, Merlin Nimier-David, Nicolas Roussel, Alex Keller
CTRL-G: Controllable Generative Graphics for Games
Josef Spjut, Arnav Jhala, Anjul Patney, Michael Lentine, Monde Duinkharjav
Understanding Emergent Non-Verbal Communication in the Delta Force Competitive Video Game through Multimodal AI Analysis
Jinyuan Guo, Josef Spjut
Clustered Codebook Quantization for 2D Gaussian-based Image Compression
Runze Cheng, Yicheng Zhan, Josef Spjut, Kaan Akşit
Real-time 3D Visualization of Radiance Fields on Light Field Displays
Jonghyun Kim, Cheng Sun, Michael Stengel, Matthew Chan, Andrew Russell, Jae-Hyun Jung, Wil Braithwaite, Shalini De Mello, David Luebke
Position: Stop Reactively Patching Your Model Every Time and Start Proactive Test-Driven AI Development
Nadine Chang, Maying Shen, Jialiang Wang, Rafid Mahmood, Jose M. Alvarez
ROSA: A Robotics Foundation Model Serving System for Robot Factories
Wenqi Jiang, Jason Clemons, Rowland O'Flaherty, Hugo Hadfield, Alperen Degirmenci, Shuran Song, Yashraj Narang, Christos Kozyrakis
Fearless Concurrency on the GPU
Melih Elibol, Jared Roesch, Isaac Gelado, Eric Buehler, Michael Garland
Masking Teacher and Reinforcing Student for Distilling Vision-Language Models
Byung-Kwan Lee, Yu-Chiang Frank Wang, Ryo Hachiuma