RPG: Guided Self-Improvement for Embodied Agents
What it is
RPG is a framework that autonomously improves robot execution systems without updating model weights by identifying capabilities in offline data and generating practice tasks in simulation. It uses execution feedback and privileged state to diagnose failures, developing reusable symbolic skills and refining system prompts, which are then used by a multimodal LLM to coordinate perception and control at test time.
The problem it solves
Developing and maintaining reliable robot capabilities across diverse tasks requires substantial human effort to design rewards, develop skills, and integrate perception with control.
What you could use it for
- Autonomous refinement of robot manipulation skills across diverse tasks
- Reducing human effort in designing robot rewards and integrating perception with control
- Improving task success rates for embodied agents through iterative simulation practice
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.