CoTrace: Data Recipes for Training Terminal Agents
What it is
This paper introduces CoTrace, a data recipe for training terminal agents that treats the runtime harness and model weights as co-evolving components. It proposes an alternating framework where trajectory value is determined by the specific harness that generated it, using provenance matching to route data for either supervised fine-tuning or reinforcement learning.
The problem it solves
Existing harness-model co-evolution approaches treat all generated trajectories as an undifferentiated replay buffer, ignoring that a trajectory's utility depends on the specific harness configuration used to generate it, which leads to inefficient training and poor transfer.
What you could use it for
- Training terminal agents to improve task-solving rates on benchmarks like Tmax
- Designing data pipelines for LLM agents where the inference harness changes over time
- Improving out-of-distribution transfer for coding agents by maintaining harness consistency
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.