A Better Critic Matters for Distribution Matching Distillation
What it is
This paper investigates the requirements for the critic model in Distribution Matching Distillation (DMD) to ensure stable training of few-step generative models. It proposes two key improvements: 'joint scaling' to match critic capacity with the teacher model, and a 'step-aware critic' (STAC) that conditions on the specific generation step to provide more accurate score estimates.
The problem it solves
Training few-step students via DMD often suffers from instability and quality degradation when the critic model is too small or fails to account for the specific generation step, leading to unreliable score estimates.
What you could use it for
- Training stable few-step diffusion models for class-conditional ImageNet generation
- Improving text-to-image generation quality in models like SDXL and FLUX.2
- Enhancing text-to-video generation capabilities in models like Wan2.1
Why it matters
Prevents training collapse in few-step distillation and consistently improves generation quality across image and video models by providing a more reliable training signal.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.