Self-Play Search Distillation for Large Language Model Reasoning
What it is
This paper introduces SPSD, a framework that generates high-quality synthetic training data by converting self-play search records from MuZero-like networks into structured chains-of-thought. It uses executable board game environments to create supervision signals that expose difficult decisions and consequences, which are then used to train LLMs for improved reasoning capabilities.
The problem it solves
The scarcity of high-quality training data that exposes difficult decisions, competing alternatives, and their consequences, driven by the low quality of existing synthetic data and the high cost of human labeling.
What you could use it for
- Improving mathematical reasoning in LLMs like Qwen3-4B-Base
- Generating synthetic data for training LLMs on complex decision-making tasks
- Transferring reasoning skills from board games to unseen mathematical benchmarks
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.