Context as Infrastructure: Knowledge Compilation for Retrieval in Agentic Systems
What it is
This paper proposes 'knowledge compilation' as a supply layer for agentic RAG systems, arguing that structural artifacts like navigation trees and entity graphs reduce context window usage rather than improving raw accuracy. It details a pipeline that enriches documents with claim-evidence pairs and other structures to allow agents to retrieve the smallest sufficient set of context, significantly reducing token costs and latency.
The problem it solves
Agentic RAG loops often fill the context window with redundant or unused passages, leading to high token costs and latency, even when accuracy is high.
What you could use it for
- Reducing token costs in agentic search loops by 38% on average
- Lowering latency for multi-hop retrieval tasks from 140s to 30s
- Managing context window limits in long-running agent sessions
- Providing governed, structured context for enterprise knowledge bases
Why it matters
Significantly reduces the computational cost and latency of agentic retrieval systems by optimizing the context supplied to LLMs, making complex multi-hop reasoning more efficient and scalable.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.