Dream to Remember: Continual Steering of Generalist Robot Policies with World Models
What it is
This paper proposes Dream to Remember (D2R), a method for continual learning in robotics that steers a frozen generalist policy using a small module. It uses a frozen world model to rehearse prior tasks through imagined rollouts, preventing catastrophic forgetting without requiring a replay buffer or new data collection.
The problem it solves
Catastrophic forgetting in continual learning, where fine-tuning or steering a robot policy on a new task causes it to lose previously learned skills.
What you could use it for
- Sequentially adding new manipulation tasks to a robot policy without degrading existing skills
- Learning new robot behaviors entirely in simulation using a world model
- Extending generalist robot policies like pi_0 to unseen tasks while retaining baseline performance
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.