The Density of Thought: Predicting and Steering Reasoning in Large Language Models
What it is
This paper investigates whether the information density of chain-of-thought reasoning steps predicts answer correctness and can be steered to improve performance. It introduces metrics like LP variance and Caveman compression ratio to measure density and proposes Entropy-Gated Density Routing (EGDR), a self-supervised method that adjusts KV-cache during generation to enhance accuracy.
The problem it solves
Current LLMs often produce inconsistent reasoning chains where information density varies unpredictably, leading to errors; there is a lack of controllable, self-supervised methods to steer this internal reasoning process during inference.
What you could use it for
- Improving the accuracy of large language models on mathematical reasoning tasks like GSM8K
- Developing inference-time steering techniques that do not require external hints or retraining
- Analyzing the relationship between model training paradigms (SFT vs RL) and reasoning behavior
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.