Candidate supply and answer selection shape the value of LLM judging in multi-agent systems
What it is
This paper analyzes multi-agent systems by decomposing reasoning into candidate generation, peer communication, and terminal selection. It demonstrates that LLM judges provide effective selection pressure when combined with answer frequency, rescuing correct answers that are outnumbered by popular errors.
The problem it solves
Multi-agent systems often fail to report correct answers even when those answers are present in the generated candidates, due to uncontrolled consensus mechanisms and lack of effective selection pressure.
What you could use it for
- Designing multi-agent architectures that prevent the loss of correct but minority candidates
- Optimizing final answer selection rules in LLM-based reasoning pipelines
- Diagnosing why multi-agent systems converge on incorrect answers despite having correct candidates
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.