METTA: Memory-Enhanced Test-Time Adaptation for Meta-Reinforcement Learning
What it is
This paper proposes METTA, a method for meta-reinforcement learning that decomposes adaptation into two temporal scales. It uses a causal neural memory for linear-complexity within-episode adaptation and compact summaries for long-range cross-episode inference, avoiding the quadratic costs of standard transformers.
The problem it solves
Classical recurrent agents compress experience too aggressively, while transformer-based agents suffer from quadratic memory and computation costs when retrieving from long interaction histories.
What you could use it for
- Training agents to adapt quickly to unseen tasks in robotic control environments like Meta-World
- Navigating long-context sparse-reward tasks such as PointMaze with structured exploration
Why it matters
Provides a scalable and efficient path for long-context meta-RL by reducing memory and computation costs while maintaining high success rates on held-out tasks.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.