PROWBench: Do Video Models Render What the Program Specifies?
What it is
PROWBench is a benchmark for evaluating programmable world models by checking if generated videos adhere to explicit program-specified rules and events. It uses 170 programmatically constructed episodes and 600 proxy videos to test fidelity to fine-grained world events, including those outside the camera's field of view.
The problem it solves
Existing benchmarks focus on visual quality and controllability but fail to test fidelity to fine-grained, program-specified world events and logical consistency.
What you could use it for
- Evaluating the visual adherence of video generation models to programmatic world states
- Testing long-horizon memory and entity control in generative game engines
- Benchmarking Logic-Render Alignment and Interaction Success Rate in world models
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.