DoCtOR: Automated Failure Attribution for Multi-Agent Systems
What it is
DoCtOR is a reflection framework for LLM-based multi-agent systems that identifies the specific agent responsible for a failure rather than forcing all agents to reflect. It uses automated failure attribution to locate the decisive error step and agent, then generates targeted corrections to improve collaboration efficiency.
The problem it solves
Current self-reflection methods in multi-agent systems force all agents to reflect on failures, which contaminates the memory of agents that behaved correctly with incorrect insights, leading to degraded performance.
What you could use it for
- Improving success rates in multi-agent systems for complex reasoning tasks like HotPotQA
- Enhancing performance in data extraction and chart understanding tasks like ChartQAPro
- Optimizing web navigation and interaction agents in benchmarks like Mind2Web
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.