What is interactive generative video?

Definition

Interactive generative video produces frames while accepting inputs that influence what happens next. Unlike a fixed generated clip, the system responds to navigation, movement or other controls during the experience.

The capability overlaps with world models when the generated environment maintains spatial and temporal consistency. Low latency and coherent state are important for interactions to feel responsive and believable.

ELI5

Interactive generative video lets viewer input affect scenes that an AI system creates during the experience. Messages, votes, or game actions can guide what the system generates next.

For example, viewers might vote for a character to enter a forest, and a later generated scene follows that choice. The response is not instant because some video may already be queued and new scenes take time to render.

Acronyms and aliases

interactive AI video variant

Frequently asked questions

How is interactive generative video different from a generated clip?

A generated clip follows a fixed sequence, while interactive video changes its next frames in response to user input.

What technical qualities matter for interaction?

Important qualities include low latency, visual coherence, stable objects, responsive controls and consistent consequences for actions.

Videos explaining interactive generative video