World Observer: Joint Actor-Observer Generation for Persistent World Modeling
What it is
This paper introduces World Observer, a video world model that decouples observation from action by jointly generating an actor-centric view and panoramic observers. It uses geometric warping from a shared panoramic source and high-resolution reference sinks to preserve the state of objects that leave the actor's field of view, allowing them to evolve correctly before re-entering the scene.
The problem it solves
Standard video world models are actor-centric and lose track of objects once they leave the agent's field of view, failing to preserve their state and dynamics when they re-enter the scene.
What you could use it for
- Simulating persistent object states in video generation models
- Evaluating out-of-view dynamics in synthetic and real-world scenes
- Improving 3D adherence and camera control in agent-centric video simulations
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.