RATED: Reliability-Aware AI Agent Tool Retrieval via Execution Dynamics
What it is
RATED is a retrieval framework that improves AI agent tool selection by combining semantic matching with dynamic reliability adaptation. It uses a frozen dual-encoder for initial candidate generation and a lightweight contextual bandit to re-rank tools based on real-time execution feedback, allowing the system to avoid failing tools without retraining.
The problem it solves
Existing tool retrieval methods optimize for semantic relevance but ignore real-time tool availability, leading agents to select tools that subsequently fail during execution.
What you could use it for
- Selecting reliable external APIs for AI agents in production environments
- Reducing agent failure rates during partial API outages
- Benchmarking tool retrieval systems using the EcoAgent dataset
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.