DyadMem: A Long-Term Memory Benchmark of How Agents Work with Users
What it is
DyadMem is a benchmark for evaluating long-term agent memory, specifically focusing on User-conditioned Relational Agent Memory (URAM) which tracks how an agent should interact with a specific user over time. It provides extensive annotations for multi-session trajectories, including capture, update, and recall tasks, to assess both user facts and relationship-specific behaviors.
The problem it solves
Existing benchmarks primarily focus on static user facts or reusable experiences, failing to capture how an agent's behavior should evolve based on its specific shared history with a user, and often rely on unreliable final-answer QA metrics.
What you could use it for
- Evaluating the long-term memory capabilities of LLMs in personalized agent scenarios
- Benchmarking the ability of agents to update and maintain relationship-specific context over multiple sessions
- Identifying failure modes in memory capture, recall, and deletion for frontier LLMs
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.