Think in 360°: Benchmarking and Bootstrapping Panoramic Video Reasoning
What it is
This paper introduces PanoVideoBench, a manually annotated benchmark for panoramic video understanding, and PanoVideoCoT, a reasoning dataset derived from real panoramic videos. It proposes PanoVideoReasoner, a model trained using Panoramic CoT SFT and Evidence-Privileged On-Policy Self-Distillation to improve cross-view and temporal reasoning in 360-degree videos.
The problem it solves
General video models struggle to connect observations across the full viewing sphere and over time, leading to poor performance on tasks requiring cross-view tracking and sphere-time evidence integration in panoramic videos.
What you could use it for
- Evaluating the spatial and temporal reasoning capabilities of multimodal large language models on 360-degree video content
- Training general video models to handle evidence distributed across the viewing sphere and time
- Benchmarking proprietary and open-source models on panoramic video understanding tasks
Why it matters
Establishes a standard for evaluating and improving panoramic video reasoning, enabling models to better understand complex 360-degree environments by integrating evidence across views and time.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.