Multi-Agent Coordination via Support-Preserving Distillation
What it is
This paper identifies a failure mode in offline multi-agent reinforcement learning (MARL) where standard flow-based teachers route nearby noise samples to conflicting coordination modes, causing errors to propagate to decentralized students. It proposes Mode-Support Semi-Discrete Optimal Transport (MoSDOT), which summarizes multimodal replay data into a finite mode support and assigns noise samples to single modes before training to improve routing consistency.
The problem it solves
Standard flow-based teachers in offline MARL pair noise with replay targets independently, causing nearby noise samples to be routed toward conflicting coordination modes, which results in the teacher producing invalid intermediate samples that are then propagated to student agents.
What you could use it for
- Training decentralized agents from centralized teachers in offline MARL settings
- Improving endpoint quality in multimodal joint behavior datasets
- Reducing mode-mixing artifacts in generative policy distillation
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.