WorldGuide: Goal-Directed Video World Model for Procedural Task Execution
What it is
WorldGuide is a closed-loop video generation system that treats procedural task execution as a planning and realization problem in visual space. It uses a Planner to predict the next atomic action from the current visual state and an Executor to generate the corresponding video clip, iterating until the task goal is met.
The problem it solves
Existing video world models struggle with long-horizon procedural tasks because open-loop generation cannot adapt to actual execution outcomes, and closed-loop systems often lack direct supervision for coupling planning with execution.
What you could use it for
- Generating long-horizon procedural videos that adapt to intermediate execution outcomes
- Automating complex multi-step visual tasks from a single initial image and goal description
- Benchmarking video world models on step-level procedural reasoning
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.