Generative Cinematographer: Composing Camera and Object Motion in 3D
What it is
This paper introduces GenCine, a system that lifts a single image into an editable 3D scene scaffold to allow artists to jointly author camera and foreground object motion. It uses local 3D motion handles and projects them into guidance maps to control a pretrained video model (Wan) via LoRA adapters, enabling consistent camera-relative motion without physics simulators.
The problem it solves
Current video generation systems rely on ambiguous 2D trajectories or sparse drag signals, which fail to distinguish between different 3D motions when both camera and objects move simultaneously.
What you could use it for
- Controlling specific object movements in video generation while the camera moves
- Creating complex camera shots with independent foreground object motions
- Improving geometric consistency in generated videos under viewpoint changes
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.