Safety of Latent Communication in Multi-Agent Systems
What it is
This paper investigates the security risks of latent communication in multi-agent systems, where agents exchange information in internal representation space rather than text. It demonstrates that even benignly trained communication links can increase harmful compliance, and that attackers can further exploit these links to significantly raise safety violations without modifying the underlying agents.
The problem it solves
Existing safety alignment focuses on individual agents, leaving a critical gap where the communication layer between agents can be exploited to induce harmful behavior even if the agents themselves are safe.
What you could use it for
- Auditing the safety of multi-agent systems that use latent or non-textual communication channels
- Developing defensive mechanisms to repair compromised communication links in agent swarms
- Benchmarking the robustness of safety-aligned agents against communication-layer attacks
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.