AdvSim2Real: Training Web Agents Against Adaptive Prompt Injection
What it is
This paper introduces AdvSim2Real, a training framework that co-evolves a task curriculum, an adaptive injection adversary, and a web agent within a frozen web world model. It addresses the limitation of static defenses by allowing the attacker to adapt to the agent's evolving capabilities, resulting in agents that are both more capable and robust against unseen attacks.
The problem it solves
Current defenses against prompt injection in web agents rely on static training data, allowing adaptive attackers to bypass them, while standard adversarial training fails to keep tasks challenging as the agent improves.
What you could use it for
- Training web agents to resist adaptive prompt injection attacks
- Developing robust autonomous agents for open-web navigation
- Benchmarking agent robustness against evolving adversarial strategies
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.