Skip to content

Learning andPerceptionResearch

Advancing Embodied and Scientific Intelligence

Embodied and Scientific Intelligence

NVIDIA’s Learning and Perception Research (LPR) group, led by Jan Kautz, advances embodied intelligence for humanoid robots, digital agents, and AI scientists. Our teams develop robot policies, efficient foundation models, and robust perception and reasoning systems. We publish our research and openly release code and models for the broader community.

LPR’s Teams

Recent Publications

View all 797

Nahual: A Sequence Model for Language and Atoms

Austin Cheng, Marcel Müller, Andreas Burger, Yeonghun Kang, Tsz W Ko, Marta Skreta, Luka Mucko, Ella Miray Rajaonson, Cher-Tian Ser, Jérôme F Gonthier, Alex Zook, Varinia Bernales, Alan Aspuru-Guzik

Advances in Neural Information Processing Systems (NeurIPS) · 2026

PointZero: 3D Point Track Completion for Learning Transferable 3D Dynamics

Bardienus Pieter Duisterhof, Kaifeng Zhang, Adam Hung, Bowen Wen, Stan Birchfield, Yunzhu Li, Deva Ramanan, Jeffrey Ichnowski

Advances in Neural Information Processing Systems (NeurIPS) · 2026

Addressable Memory for Video World Models

Xindi Wu, Sven Elflein, James Lucas, Olga Russakovsky, Laura Leal-Taixé, Despoina Paschalidou, Jonathan Lorraine, Aljoša Ošep

Advances in Neural Information Processing Systems (NeurIPS) · 2026

LLM-as-a-Tutor: Policy-Aware Prompt Adaptation for Non-Verifiable RL

Yujin Kim, Namgyu Ho, Sangmin Hwang, Joonkee Kim, Yongjin Yang, Sangmin Bae, Seungone Kim, Jaehun Jung, Se-Young Yun, Hwanjun Song

Advances in Neural Information Processing Systems (NeurIPS) · 2026

Nemotron-Labs-Diffusion-Image: Advancing Masked Discrete Diffusion for High-Resolution Image Synthesis

Shufan Li, Greg Heinrich, Hanrong Ye, Yonggan Fu, Aditya Grover, Jan Kautz, Pavlo Molchanov

Advances in Neural Information Processing Systems (NeurIPS) · 2026

Flow Map Denoisers: Traversing the Distortion-Perception Plane for Inverse Problems

Nicolas Zilberstein, Morteza Mardani, Santiago Segarra

Advances in Neural Information Processing Systems (NeurIPS) · 2026