Cooperative Multi-Agent Reinforcement Learning with Submodular Trajectory Rewards
What it is
This paper proposes a greedy algorithm for cooperative multi-agent reinforcement learning that handles non-additive, submodular rewards over joint trajectories. It introduces a 'pre-window curvature' metric to bound the error of restricting agent policies to a finite history, enabling polynomial-time optimization with theoretical approximation guarantees.
The problem it solves
Exact optimization of cooperative multi-agent policies with non-additive (submodular) rewards is computationally intractable (exponential in horizon and number of agents) because optimal policies may depend on the full history of all agents.
What you could use it for
- Multi-agent traffic monitoring and control
- Cooperative resource allocation with diminishing returns
- Decoupled multi-agent systems with complex, non-additive global rewards
Why it matters
Enables scalable, theoretically grounded optimization for cooperative multi-agent systems where rewards are non-additive, avoiding the exponential complexity of exact methods while providing provable approximation bounds.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.