The Quine Test: How Much of a Model's Self Survives Its Own Description?
What it is
This paper investigates whether a language model's self-description can serve as a portable specification of its preferences by testing if other models can replicate the author's behavior when given that description. It finds that while self-descriptions influence behavior, they do not reliably reconstruct the original model's preference profile in other instances, whereas explicitly listing the author's answers achieves high fidelity.
The problem it solves
The inability to distinguish whether a language model's expressed preferences are intrinsic to the model or merely a character it is portraying, and the lack of a quantitative test for whether a model's self-description can faithfully regenerate its behavior in other models.
What you could use it for
- Evaluating the portability of AI agent personas across different model architectures
- Benchmarking the fidelity of self-referential prompts in LLMs
- Studying the distinction between a model's intrinsic preferences and its portrayed character
Why it matters
Provides a rigorous method for measuring the 'self' of LLMs, clarifying that self-descriptions are not sufficient for exact behavioral replication, which has implications for AI safety, interpretability, and the design of persistent agent identities.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.