HuGe: Scaling Humanoid Generalist Vision-Language-Action Models with Egocentric Experience
What it is
HuGe is a family of Vision-Language-Action (VLA) models designed for humanoid robots, pre-trained on over 2,000 hours of egocentric human and robot data. It uses a three-stage training pipeline to bridge the gap between human demonstrations and robot control by predicting latent motion tokens for a whole-body controller and generating pseudo-proprioceptive states.
The problem it solves
Collecting diverse, high-quality demonstrations for humanoid robots is costly and time-consuming, and direct transfer from human video is hindered by differences in visual embodiment and missing robot proprioception.
What you could use it for
- Training generalist policies for humanoid robots like the Unitree G1
- Transferring skills from egocentric human video data to robotic embodiments
- Improving pick-and-drop task success rates in real-world humanoid deployments
Why it matters
Significantly reduces the cost of collecting robot-specific demonstrations by leveraging abundant human egocentric data, enabling scalable and generalist humanoid control.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.