Choosing LLMs for Strategic Agent Interactions
What it is
This paper introduces a framework for selecting Large Language Models (LLMs) for strategic interactions by treating model selection as a meta-game layered over the base game. It evaluates 10 LLMs across 5 games to show that strategic competence varies significantly by opponent and setup, and proposes a lightweight multi-armed bandit algorithm for dynamic model selection.
The problem it solves
Current LLM routers optimize for quality-cost trade-offs but ignore strategic structure, failing to account for unknown or adaptive opponents that shift the feedback signal over time.
What you could use it for
- Dynamically selecting the best LLM from a portfolio for ongoing strategic negotiations or games
- Benchmarking LLMs against adaptive or unknown opponents in game-theoretic scenarios
- Designing agent systems that must balance quality and cost while facing shifting strategic environments
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.