MTA-OPSD: Multi-teacher Adaptive On-policy Self-distillation
What it is
This paper proposes MTA-OPSD, a method for post-training large language models that adapts teacher supervision at the token level rather than the response level. It constructs a pool of candidate teachers and allows each token to select its preferred teacher via majority voting and KL-based selection during training.
The problem it solves
Existing On-policy Self-distillation (OPSD) methods keep the teacher fixed either throughout training or within each response, failing to account for the fact that teacher preference can vary token by token within the same response.
What you could use it for
- Post-training LLMs for mathematical reasoning
- Improving model performance through adaptive self-distillation
- Fine-tuning Qwen3 models
Why it matters
Consistently outperforms existing OPSD approaches with an average gain of up to +5.9 over the base model on mathematical reasoning tasks.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.