SCOUT: Retrospective Distillation Attribution
What it is
SCOUT is a method for attributing the source of model distillation using only the current text outputs of a student model. It works by aggregating recurring syntactic patterns into candidate profiles and calibrating distances to identify the teacher model, even after the student has undergone further training like RLHF.
The problem it solves
Existing distillation attribution methods fail when the student model undergoes further training (SFT, RLHF) after distillation, or when auditors lack access to the pre-distillation checkpoint.
What you could use it for
- Auditing the provenance of publicly released LLMs to identify their distillation sources
- Detecting unauthorized distillation from commercial APIs
- Tracing the persistence of teacher-specific syntactic signatures through post-training stages
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.