CLIFT: Conformal Self-Verification for Web Agent Training and Test-Time Scaling
What it is
CLIFT is a method for training and scaling web agents using conformal self-verification. It uses a Compositional Conformal Certifier to filter and weight the agent's self-generated verification questions during training, and reuses this certified bank at test time for judge-free trajectory selection.
The problem it solves
Training web agents with reinforcement learning is difficult because binary task success is too sparse for credit assignment, and using frontier LLMs as judges is too expensive and unavailable at deployment time.
What you could use it for
- Training open-source web agents with dense, reliable reward signals without relying on expensive external LLM judges at every step.
- Improving test-time performance of web agents by selecting the best rollout from multiple samples using a frozen, certified self-verification bank.
- Transferring verification capabilities from open models to proprietary models like GPT-5.5 for zero-shot evaluation on live web benchmarks.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.