PASS: Adaptive SFT Instruction Selection for Long-Tail Concepts
What it is
This paper introduces the concept of 'prior barriers' to quantify how well pretrained LLMs support rare versus frequent concepts. It proposes PASS, an adaptive method that selects fine-tuning instructions by estimating the distinguishing evidence each provides and allocating the budget toward concepts that are insufficiently covered.
The problem it solves
Standard supervised fine-tuning often treats all training data equally, failing to account for the fact that rare concepts in the pretraining distribution have weaker representations and require more specific instructional evidence to learn effectively.
What you could use it for
- Selecting high-value training data for supervised fine-tuning of LLMs
- Improving model performance on rare or long-tail concepts during adaptation
- Optimizing limited fine-tuning budgets by prioritizing instructions that overcome high prior barriers
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.