CIPR: Benchmark for Coding Agent Vulnerability to Repository Poisoning
What it is
This paper introduces CIPR, a benchmark of 1,920 instances designed to evaluate how user-side prompt configurations (PLCs) affect coding agents' susceptibility to repository poisoning. It systematically varies task types, prompt styles, and skill rules to measure attack success rates and agent alert rates in real-world poisoned repositories.
The problem it solves
Prior research on repository poisoning focused primarily on attacker-side injection techniques, neglecting the significant role that everyday user invocation choices (task type, prompt phrasing, and supplied skills) play in shaping the agent's vulnerability to attacks.
What you could use it for
- Evaluating the security robustness of LLM-based coding agents against prompt injection and repository poisoning.
- Analyzing how specific user prompt phrasing and task delegation choices influence the likelihood of successful attacks.
- Benchmarking the effectiveness of agent alert mechanisms under different contextual configurations.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.