Disentangling Paradigm, Identifier, and Decoding in Generative Retrieval
What it is
This paper investigates the individual contributions of model paradigm (autoregressive vs. diffusion), identifier type, and decoding strategy in generative retrieval systems. By training models with fixed budgets and varying only one factor at a time, it isolates how much performance variance is due to the decoding method versus the model architecture itself.
The problem it solves
Previous studies conflated changes in model paradigm, identifier design, and decoding strategy, making it impossible to determine which factor actually drives performance improvements in generative retrieval.
What you could use it for
- Designing generative retrieval systems for large-scale document search
- Selecting optimal decoding strategies for diffusion-based language models
- Benchmarking the effectiveness of different identifier schemes (RQ, PQ, random) in retrieval tasks
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.