MERGE: Multi-LLM Ensemble for Retrieval via Generative Enrichment
What it is
MERGE is a two-stage framework that uses three heterogeneous open-source LLMs to independently expand user queries, followed by a larger LLM that synthesizes these expansions into a single optimized query. It integrates a task-grounded Automatic Prompt Optimization (APO) loop that tunes prompts based on downstream retrieval performance rather than LLM evaluation, allowing the system to adapt to different models without manual prompt engineering.
The problem it solves
Single LLMs for query expansion are limited by training biases and require expensive, non-scalable manual prompt engineering for each new model.
What you could use it for
- Improving BM25 retrieval accuracy on diverse benchmarks like NQ, SciFact, and FiQA
- Automating query expansion for information retrieval systems using compact open-source models
- Scaling prompt engineering across multiple LLMs in an ensemble setting
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.