Publications | Research

164 results found
Robotics

Clear all

Robotics

2026

ScheduleStream: Temporal Planning with Samplers for GPU-Accelerated Multi-Arm Task and Motion Planning & Scheduling

Caelan Garrett, Fabio Ramos

2025

Generalizable Domain Adaptation for Sim-and-Real Policy Co-Training

Shuo Cheng, Liqian Ma, Zhenyang Chen, Ajay Mandlekar, Caelan Garrett, Danfei Xu

NeurIPS

ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planning

Chi-Pin Huang, Yueh-Hua Wu, Min-Hung Chen, Frank Wang, Fred Yang

NeurIPS

Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification

Yilin Wu, Anqi Li, Tucker Hermans, Fabio Ramos, Andrea Bajcs, Claudia Pérez D’Arpino

The Reality Gap in Robotics: Challenges, Solutions, and Best Practices

Elie Aljalbout, Jiaxu Xing, Angel Romero, Iretiayo Akinola, Caelan Garrett, Eric Heiden, Abhishek Gupta, Tucker Hermans, Yashraj Narang, Dieter Fox, Davide Scaramuzza, Fabio Ramos

ACGD: Visual Multitask Policy Learning with Asymmetric Critic Guided Distillation

Krishnan Srinivasan, Jie Xu, Henry Ang, Eric Heiden, Dieter Fox, Jeannette Bohg, Animesh Garg

IROS

Isaac Lab: A GPU Accelerated Simulation Framework For Multi-Modal Robot Learning

Mayank Mittal, Kelly Guo, Gavriel State, Spencer Huang

World Simulation With Video Foundation Models for Physical AI

Ming-Yu Liu,

VT-Refine: Learning Bimanual Assembly with Visuo-Tactile Feedback via Simulation Fine-Tuning

Binghao Huang, Jie Xu, Iretiayo Akinola, Wei Yang, Balakumar Sundaralingam, Rowland O'Flaherty, Dieter Fox, Xiaolong Wang, Arsalan Mousavian, Yu-Wei Chao, Yunzhu Li

CORL

Dexplore: Scalable Neural Control for Dexterous Manipulation from Reference-Scoped Exploration

Sirui Xu, Yu-Wei Chao, Liuyu Bian, Arsalan Mousavian, Yu-Xiong Wang, Liang-Yan Gui, Wei Yang

CORL

Neural Robot Dynamics

Jie Xu, Eric Heiden, Iretiayo Akinola, Dieter Fox, Miles Macklin, Yashraj Narang

CORL

Sim2Val: Leveraging Correlation Across Test Platforms for Variance-Reduced Metric Estimation

Rachel Luo, Heng Yang, Michael Watson, Apoorva Sharma, Sushant Veer, Edward Schmerling, Marco Pavone

RoboArena: Distributed Real-World Evaluation of Generalist Robot Policies

Pranav Atreya, Karl Pertsch, Tony Lee, Moo Jin Kim, Arhan Jain, Artur Kuramshin, Clemens Eppner, Cyrus Neary, Edward Hu, Fabio Ramos, Jonathan Tremblay, Kanav Arora, Kirsty Ellis, Luca Macesanu, Marcel Torne Villasevil, Matthew Leonard, Meedeum Cho, Ozgur Aslan, Shivin Dass, Jie Wang, William Reger, Xingfang Yuan, Xuning Yang, Abhishek Gupta, Dinesh Jayaraman, Glen Berseth, Kostas Daniilidis, Roberto Martin-Martin, Youngwoon Lee, Percy Liang, Chelsea Finn, Sergey Levine

CORL

Learning to Plan & Schedule with Reinforcement-Learned Bimanual Robot Skills

Weikang Wan, Fabio Ramos, Xuning Yang, Caelan Garrett

CORL

ReinforceGen: Hybrid Skill Policies with Automated Data Generation and Reinforcement Learning

Zihan Zhou, Animesh Garg, Ajay Mandlekar, Caelan Garrett

Towards a VLM Benchmark for Simulated Robotics

Xuning Yang, Clemens Eppner, Valts Blukis, Peter Belcak, Stephen Tyree, Stan Birchfield, Fabio Ramos, Jonathan Tremblay

Robot policy evaluation for sim-to-real transfer: A benchmarking perspective

Xuning Yang, Clemens Eppner, Jonathan Tremblay, Dieter Fox, Stan Birchfield, Fabio Ramos

FoundationStereo: Zero-Shot Stereo Matching

Bowen Wen, Matthew Trepte, Joseph Aribido, Jan Kautz, Orazio Gallo, Stan Birchfield

CVPR

Best Paper Nomination

RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Robotics

Chan Hee Song, Valts Blukis, Jonathan Tremblay, Stephen Tyree, Yu Su, Stan Birchfield

CVPR

Inference-Time Policy Steering through Human Interactions

Yanwei Wang, Lirui Wang, Yilun Du, Balakumar Sundaralingam, Xuning Yang, Yu-Wei Chao, Claudia Pérez D’Arpino , Dieter Fox, Julie Shah

ICRA

TWIN: Two-handed Intelligent Benchmark for Bimanual Manipulation

Markus Grotz, Mohit Shridhar, Yu-Wei Chao, Tamim Asfour, Dieter Fox

ICRA

SPOT: SE(3) Pose Trajectory Diffusion for Object-Centric Manipulation

Cheng-Chun Hsu, Bowen Wen, Jie Xu, Yashraj Narang, , Yuke Zhu, Joydeep Biswas, Stan Birchfield

ICRA

Latent Action Pretraining from Videos

Seonghyeon Ye, Joel Jang, Byeongguk Jeon, Sejune Joo, Jianwei Yang, Baolin Peng, Ajay Mandlekar, Reuben Tan, Yu-Wei Chao, Yuchen Lin, Lars Liden, Kimin Lee, Jianfeng Gao, Luke Zettlemoyer, Dieter Fox, Minjoon Seo

ICLR

Aim My Robot: Precision Local Navigation to Any Object

Xiangyun Meng, Xuning Yang, Sanghun Jung, Fabio Ramos, Sri Sadhan Jujjavarapu, Sanjoy Paul, Dieter Fox

Cosmos Transfer 1: World-to-World Transfer with Adaptive Multi-Control for Physical AI

Ming-Yu Liu

Cosmos-Reason 1: From Physical AI Common Sense to Embodied Decisions

Tsung-Yi Lin, Ming-Yu Liu

NVIDIA Isaac GR00T N1: An Open Foundation Model for Humanoid Robots

Yuke Zhu, Linxi "Jim" Fan, NVIDIA GEAR Team

Principles and guidelines for evaluating social robot navigation algorithms

Anthony Francis*, Claudia Pérez D’Arpino*, CHENGSHU LI, FEI XIA, ALEXANDRE ALAHI, RACHID ALAMI, ANIKET BERA, ABHIJAT BISWAS, JOYDEEP BISWAS, ROHAN CHANDRA, HAO-TIEN LEWIS CHIANG, MICHAEL EVERETT, SEHOON HA, JUSTIN HART, JONATHAN P. HOW, HARESH KARNAN, TSANG-WEI EDWARD LEE, LUIS J. MANSO, REUTH MIRSKY, SÖREN PIRK, PHANI TEJA SINGAMANENI, PETER STONE, ADA V. TAYLOR, PETER TRAUTMAN, NATHAN TSOI, MARYNEL VÁZQUEZ, XUESU XIAO, PENG XU, NAOKI YOKOYAMA, ALEXANDER TOSHEV, ROBERTO MARTÍN-MARTÍN

Cosmos World Foundation Model Platform for Physical AI

Ming-Yu Liu, Many other contributors at https://d1qx31qr3h6wln.cloudfront.net/publications/NVIDIA%20Cosmos_4.pdf, Jing Zhang

TacSL: A Library for Visuotactile Sensor Simulation and Learning

Iretiayo Akinola, Jie Xu, Jan Carius, Dieter Fox, Yashraj Narang