AgentCIScope: Grounded Contextual Integrity Evaluation for LLM Agents
What it is
AgentCIScope is a unified platform and benchmark for evaluating whether LLM agents preserve contextual integrity (CI) when handling sensitive user data. It transforms privacy cases into executable, multi-step tasks across realistic application environments, grounding disclosure constraints in privacy policies, persona agreements, and sensitive-attribute taxonomies.
The problem it solves
Existing evaluations focus on model-level leakage or use limited environments with manually constructed constraints, failing to assess agent-level contextual integrity in realistic, multi-step application workflows.
What you could use it for
- Benchmarking the privacy leakage rates of different LLM agents
- Testing agent behavior against specific contextual integrity constraints
- Developing and validating privacy-preserving agent architectures
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.