Do LLM Agents Execute the Plans They Declare? From Planning-Mode Declaration to Pattern-Specific Execution
What it is
This paper investigates the gap between the planning modes LLM agents declare and how they actually execute them. It introduces 'Planning-as-Routing,' a method where a deterministic router dispatches tasks to pattern-specific executors based on the declared planning mode (e.g., Sequential, Hierarchical, Search). The study evaluates this approach across four benchmarks and three LLMs to isolate execution failures from selection failures.
The problem it solves
Existing planner-executor systems often fail because generic agents (like Plan+ReAct) do not faithfully preserve the declared planning structure during execution, and final success metrics cannot distinguish between poor plan selection and poor execution.
What you could use it for
- Improving the reliability of LLM agents on long-horizon tasks like software engineering (SWE-bench) and household simulation (ALFWorld)
- Designing agent architectures that enforce specific planning structures to prevent structural drift
- Evaluating the effectiveness of different planning strategies (Search vs. Hierarchical) across different environments
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.