Cosmos World Foundation Model Platform for Physical AI

Publication image

Physical AI needs to be trained digitally first. It needs a digital twin of itself, the policy model, and a
digital twin of the world, the world model. In this paper, we present the Cosmos World Foundation Model
Platform to help developers build customized world models for their Physical AI setups. We position
a world foundation model as a general-purpose world model that can be fine-tuned into customized
world models for downstream applications. Our platform covers a video curation pipeline, pre-trained
world foundation models, examples of post-training of pre-trained world foundation models, and video
tokenizers. To help Physical AI builders solve the most critical problems of our society, we make our
platform open-source and our models open-weight with permissive licenses available via NVIDIA Cosmos.

Authors

https://d1qx31qr3h6wln.cloudfront.net/publications/NVIDIA%20Cosmos_4.pdf (NVIDIA)

Publication Date

Uploaded Files