Bayesian Offline Multi-Agent Reinforcement Learning with Latent World Models
What it is
This paper proposes a Bayesian framework for offline multi-agent reinforcement learning that infers latent global states from decentralized observations. It introduces Multi-Agent Posterior Information Loss (MPIL) as a reliability metric to iteratively refine world models and bound policy regret.
The problem it solves
Existing model-based offline MARL methods suffer from out-of-distribution model errors due to limited data coverage, often relying on global states or conservative optimization without directly refining the reliability of the learned world models.
What you could use it for
- Training multi-agent policies from limited offline data where global state is unobserved
- Evaluating the reliability of learned world models in partially observable environments
- Improving policy performance in multi-agent MuJoCo tasks with sparse dataset coverage
Why it matters
Provides a principled, theoretically grounded method for reliable world model learning in offline multi-agent settings, potentially enabling safer and more effective decision-making from limited historical data.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.