CAVEAT: Towards Robust Computer-Use Agents in Incentive-Misaligned Environments
What it is
This paper introduces CAVEAT, a benchmark designed to test computer-use agents in online marketplaces where platform incentives may conflict with user goals. It identifies specific failure modes where agents are steered away from user-optimal decisions and proposes CAVEAT-Harness, an intervention that significantly improves robustness.
The problem it solves
Existing benchmarks fail to test whether agents preserve user objectives when the environment itself has conflicting financial or strategic incentives.
What you could use it for
- Evaluating the robustness of LLM agents against subtle environmental manipulation
- Developing safety mechanisms for autonomous agents operating in commercial environments
- Benchmarking model families for their ability to maintain user objectives under conflicting incentives
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.