What is a world model?

Definition

A world model represents entities, spatial relationships, dynamics and possible future states of an environment. It can help an AI system predict what may happen after an action.

Generative world models can produce navigable visual environments that respond to user commands. Coherence over time matters because objects and rules should remain consistent as the viewpoint or action changes.

ELI5

A world model is an AI's simplified picture of how things work and change. It helps the system guess what may happen next when an object moves or an action is taken.

For example, a useful video model should understand that a rolling ball can hit a cup and knock it over, not just draw attractive frames. That prediction can make motion more believable, but the model may still fail when the scene contains unusual physics or events it has not learned.

What can a world model represent?

It can represent objects, space, motion, cause and effect, actions and likely future states.

Why is coherence important in a generated world?

Users need objects, locations and consequences to remain consistent so navigation and actions have understandable effects.

  1. The words AI Models Move Fast beside a flat hub connecting world, code and weather symbols
  2. The words AI Builds Worlds beside a blue geometric world block
  3. Sam Ramji beside the headline AI Hardware Bottleneck on a black background.
  4. Dumitru Erhan, Shixiang Shane Gu, Nicole Brichtova and Shawn Wang beside the words The Next Era of Generative Media
  5. Ming-Yu Liu in glasses and a blue top rests one hand at his chin beside the white-and-blue headline ‘COSMOS FOR HOME ROBOTS’ on black.
    NVIDIA Cosmos and the Road to Home Robots
    Nate B Jones46m 27s1 VIEW
  6. The words Open Models Surge beside a rising three-bar graphic
    The Week Open Models Closed the Gap
    AI Search43m 53s1 VIEW
  7. Pim de Witte in blue and Sophia Dew in off-white flank the blue and white “GAME CONTROLLERS ROBOT INTERFACES” headline on black.
  8. Tim Simmons beside the blue-and-white headline “SEEDANCE 2.5 WORKFLOW TEST” on a black background.
Definition card for world model: What is a world model?

A world model learns how an environment is structured and how it may change in response to actions.