## World Simulation ### Associated Publications ### 2026 [Imitation Learning of Avoidance Modes for Efficient Multimodal Model Predictive Control](/publication/2026-12_imitation-learning-avoidance-modes-efficient-multimodal-model-predictive) Changyu Lee, [Byung-Kwan Lee](/person/byung-kwan-lee), Kanghoon Yoon [ArXiv](https://arxiv.org/abs/2610.16326) [Addressable Memory for Video World Models](/publication/2026-08_addressable-memory-video-world-models) Xindi Wu, Sven Elflein, James Lucas, Olga Russakovsky, Laura Leal-Taixé, Despoina Paschalidou, [Jonathan Lorraine](/person/jonathan-lorraine), Aljoša Ošep [NeurIPS](https://neurips.cc/Conferences/2026) Best Paper, Oral F2S Workshop [CTRL-G: Controllable Generative Graphics for Games](/publication/2026-07_ctrl-g-controllable-generative-graphics-games) [Josef Spjut](/person/josef-spjut), Arnav Jhala, Anjul Patney, Michael Lentine, Monde Duinkharjav [SIGGRAPH Frontiers](https://dl.acm.org/doi/full/10.1145/3799885.3816015) [Pedestrian Collision Detection and Avoidance in Cerebral Visual Impairment During Unrestricted Walking in an Immersive Virtual Reality Environment](/index.php/publication/2026-06_pedestrian-collision-detection-and-avoidance-cerebral-visual-impairment-during) Jonathan Doyon, Madeleine Heynan, Wei Hay Lew, Alex D. Hwang, [Jae-Hyun Jung](/index.php/person/jae-hyun-jung), Lotfi B. Merabet [NIH PubMed Central](https://pmc.ncbi.nlm.nih.gov/articles/PMC13321285/) [NVIDIA OmniDreams: Real-Time Generative World Model for Closed-Loop Autonomous Vehicle Simulation](/publication/2026-06_nvidia-omnidreams-real-time-generative-world-model-closed-loop-autonomous) Aarti Basant, Amlan Kar, Despoina Paschalidou, Fangyin Wei, [Francesco Ferroni](/person/francesco-ferroni), Guillermo Garcia Cobo, [Haithem Turki](/person/haithem-turki), Huan Ling, Jaewoo Seo, James Lucas, Jay Zhangjie Wu, [Jialiang Wang](/person/jialiang-wang), [Jonathan Lorraine](/person/jonathan-lorraine), Jun Gao, Kai He, Katarina Tothova, Kevin Xie, Michał Tyszkiewicz, Qi Wu, Riccardo de Lutio, Ruilong Li, Sanja Fidler, Seung Wook Kim, Tianchang Shen, Tianshi Cao, Tobias Pfaff, William Lew, Xindi Wu, Xuanchi Ren, Yifan Lu, Yuxuan Zhang, Zan Gojcic, Zian Wang [Whitepaper](https://research.nvidia.com/labs/sil/projects/omnidreams-blog/paper.pdf) ### 2025 [Beyond Behavior Cloning in Autonomous Driving: a Survey of Closed-Loop Training Techniques](/publication/2025-12_beyond-behavior-cloning-autonomous-driving-survey-closed-loop-training) [Peter Karkus](/person/peter-karkus), [Maximilian Igl](/person/maximilian-igl), [Yuxiao Chen](/person/yuxiao-chen), Kashyap Chitta, Jef Packer, [Bertrand Douillard](/person/bertrand-douillard), [Thomas Tian](/person/thomas-tian), Alexander Naumann, Guillermo Garcia-Cobo, Shuhan Tan, [Alperen Degirmenci](/person/alperen-degirmenci), Alexander Popov, Nikolai Smolyanskiy, Urs Muller, [Boris Ivanovic](/person/boris-ivanovic), [Marco Pavone](/person/marco-pavone) [Pedestrian Collision Avoidance in Hemianopia during Natural Walking in Immersive Virtual Reality](/publication/2025-10_pedestrian-collision-avoidance-hemianopia-during-natural-walking-immersive) Jonathan K. Doyon, Sujin Kim, Alex D. Hwang, [Jae-Hyun Jung](/person/jae-hyun-jung) [arXiv](https://arxiv.org/abs/2510.04218) [World Simulation With Video Foundation Models for Physical AI](/publication/2025-09_world-simulation-video-foundation-models-physical-ai) [Ming-Yu Liu](/person/ming-yu-liu), [Sionna RT: Technical Report](/index.php/publication/2025-04_sionna-rt-technical-report) [Fayçal Aït Aoudia ](/index.php/person/faycal-ait-aoudia), [Jakob Hoydis](/index.php/person/jakob-hoydis), [Merlin Nimier-David](/index.php/person/merlin-nimier-david), [Sebastian Cammerer](/index.php/person/sebastian-cammerer), [Alex Keller](/index.php/person/alex-keller) ### 2024 [QUEEN: QUantized Efficient ENcoding for Streaming Free-viewpoint Videos](/publication/2024-12_queen-quantized-efficient-encoding-streaming-free-viewpoint-videos) Sharath Girish, [Tianye Li](/person/tianye-li), [Amrita Mazumdar](/person/amrita-mazumdar), Abhinav Shrivastava, [David Luebke](/person/david-luebke), [Shalini De Mello](/person/shalini-de-mello) [Advances in Neural Information Processing Systems (NeurIPS) 2024](https://proceedings.neurips.cc/paper_files/paper/2024/hash/4c9477b9e2c7ec0ad3f4f15077aaf85a-Abstract-Conference.html) [Learning Radio Environments by Differentiable Ray Tracing](/publication/2024-10_learning-radio-environments-differentiable-ray-tracing) [Jakob Hoydis](/person/jakob-hoydis), [Fayçal Aït Aoudia ](/person/faycal-ait-aoudia), [Sebastian Cammerer](/person/sebastian-cammerer), Florian Euchner, [Merlin Nimier-David](/person/merlin-nimier-david), Stephan ten Brink [IEEE Transactions on Machine Learning in Communications and Networking](https://ieeexplore.ieee.org/abstract/document/10705152) [Dream-in-4D: A Unified Approach for Text- and Image-guided 4D Scene Generation](/publication/2024-06_dream-4d-unified-approach-text-and-image-guided-4d-scene-generation) Yufeng Zheng, [Xueting Li](/person/xueting-li), [Koki Nagano](/person/koki-nagano), [Sifei Liu](/person/sifei-liu), Otmar Hilliges, [Shalini De Mello](/person/shalini-de-mello) [IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2024](https://openaccess.thecvf.com/content/CVPR2024/papers/Zheng_A_Unified_Approach_for_Text-_and_Image-guided_4D_Scene_Generation_CVPR_2024_paper.pdf) ### Researchers [David Sami](/person/david-sami) [Elie Aljalbout](/person/elie-aljalbout) [Haithem Turki](/person/haithem-turki) [Jonathan Lorraine](/person/jonathan-lorraine) [Json Zhou](/person/json-zhou) [Shaowei Liu](/person/shaowei-liu) [Tianyi Xie](/person/tianyi-xie)