MDSKILL: Learning to Internalize Skill Memory through Multi-View Distillation
What it is
MDSKILL is a method for improving self-evolving agents by organizing skill memories into three complementary views: state grounding, action planning, and execution control. It uses On-Policy Self-Distillation (OPSD) to transfer knowledge from these specific views into a shared policy, allowing the agent to internalize experiences without relying on external teacher models.
The problem it solves
Direct distillation of self-generated skill memories is difficult because they often contain noisy supervision and functionally entangled, redundant, or conflicting knowledge, which can hinder learning and degrade performance under limited training budgets.
What you could use it for
- Improving the performance of reinforcement learning agents in dynamic environments like ALFWorld and WebShop
- Accelerating policy learning for self-evolving agents by distilling high-quality skill memories
- Reducing noise and redundancy in agent skill memories through multi-view organization
Why it matters
Enables more efficient and effective self-evolution of AI agents by allowing them to internalize past experiences into their core policy, potentially leading to significant performance gains in complex decision-making tasks without additional computational overhead.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.