OGPO: Offline Goal-conditioned Policy Optimization for Recoverable Vision-Language-Action Models
What it is
This paper proposes OGPO, a framework for post-training Vision-Language-Action (VLA) models that shifts from trajectory-level imitation to goal-conditioned learning. It relabels offline demonstrations with semantic key states and uses process rewards to optimize policies for reaching task-progress states, enabling robust recovery from off-demonstration deviations.
The problem it solves
Standard VLA post-training relies on trajectory-level supervised imitation, which biases policies toward specific expert paths and provides limited guidance for recovering when execution deviates from demonstrated trajectories.
What you could use it for
- Improving the robustness of robotic manipulation policies against distribution shifts
- Enabling VLA models to recover from execution errors without online interaction
- Training policies to complete tasks from mid-execution perturbation states
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.