LLMs underrepresent malice and overreport virtue
What it is
This paper investigates how aligned large language models interpret human motives, specifically comparing their internal representations with their final outputs. It finds that LLMs are more charitable than humans, a bias caused by both reduced internal signals for malevolent motives and amplified reporting of benevolent ones.
The problem it solves
Users assume LLMs infer motives like humans, but aligned models systematically skew toward benevolence, potentially masking malicious intent in behavioral analysis.
What you could use it for
- Calibrating LLM outputs for psychological or behavioral analysis
- Designing evaluation benchmarks for LLM social intelligence
- Understanding the alignment gap between model internals and user-facing text
Why it matters
Reveals a specific dual-mechanism bias in LLMs that could lead to systematic misinterpretation of human intent in high-stakes applications like HR, legal, or security contexts.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.