DMReranker: Instruction-Following Reranking via Multiplying Small Questions
What it is
DMReranker is a zero-shot reranking method that decomposes instructed search queries into a topic and a list of typed clauses. It uses a small judge model to answer one narrow question per clause and multiplies the answer probabilities to generate a final relevance score, improving instruction sensitivity without training.
The problem it solves
Standard rerankers treat instructions as noise or extra words, failing to effectively filter results based on specific constraints (e.g., 'beginner-friendly', 'official sources'), leading to low instruction sensitivity scores.
What you could use it for
- Web search engines needing to respect specific user constraints like language or audience level
- Enterprise search systems filtering for official or specific document types
- Improving the instruction-following capabilities of existing LLM-based rerankers
Why it matters
Significantly improves the ability of search systems to adhere to complex user instructions, potentially making search results much more relevant and trustworthy for users with specific needs.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.