JoHan: Video-Conditioned Generative Joint 2D-3D Hand Motion Recovery
What it is
JoHan is a unified generative framework that recovers 3D hand motion directly from video sequences without relying on intermediate per-frame pose predictions. It jointly generates aligned 2D and 3D local hand pose sequences by learning temporal dynamics and cross-representation correspondence, using 2D trajectories to guide 3D reconstruction and ensuring temporal consistency.
The problem it solves
Recovering faithful 3D hand motion from video is challenging due to frequent occlusions and incomplete visual observations, which make frame-wise pose estimates unreliable and temporally inconsistent.
What you could use it for
- Recovering smooth and accurate 3D hand motion from monocular video
- Estimating hand pose and camera-space position in occluded scenes
- Improving temporal consistency in hand tracking for animation or robotics
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.