LAND: Learning an Adaptive Number of Draws for Bayesian Best-of-N Selection
What it is
LAND is a Bayesian method that dynamically allocates sampling effort in Best-of-N decoding by learning the marginal value of additional draws. It stops sampling for a source when the expected improvement falls below a shared compute cost, optimizing the trade-off between quality and efficiency.
The problem it solves
Standard Best-of-N decoding wastes compute by allocating equal sampling effort to all sources, ignoring that some sources benefit more from additional samples than others.
What you could use it for
- Efficient machine translation using multiple LLMs
- Cost-optimized LLM inference for high-volume tasks
- Adaptive sampling for multi-model ensemble selection
Why it matters
Reduces the computational cost of Best-of-N decoding by 20-40% while maintaining or improving output quality, making high-quality LLM generation more economically viable.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.