TRCA: Transition-wise Rubric Credit Assignment
What it is
TRCA is a reinforcement learning framework for long-horizon LLM agents that provides fine-grained credit assignment by evaluating individual action transitions. It uses three rubrics (Evidence, Execution, and Invalidity) to reward information acquisition and valid task progress without requiring expensive process evaluators or scarce successful trajectories.
The problem it solves
Sparse terminal rewards make it difficult for agents to learn which specific actions in a long sequence led to success or failure.
What you could use it for
- Training LLM agents for long-horizon tasks with sparse rewards (e.g., web navigation, complex search)
- Improving multi-step reasoning and planning in agents by rewarding incremental progress
- Fine-tuning models on tasks where only the final outcome is known
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.