Low-Rank Space for LLM-Brain Alignment
What it is
This paper investigates the alignment between Large Language Model (LLM) representations and human neural activity during naturalistic language listening. It uses ridge reduced-rank regression to identify a low-dimensional subspace (1-3% of original dimensionality) that captures the linear predictivity of neural responses, showing that this brain-predictive space is distinct from the principal components of the LLM embeddings.
The problem it solves
It is unclear which specific components of LLM representations drive their alignment with human neural activity, as standard dimensionality reduction techniques like PCA do not capture the directions most useful for predicting neural responses.
What you could use it for
- Identifying specific LLM features that correlate with human brain activity
- Reducing the dimensionality of LLM representations for neuroscientific analysis
- Comparing autoregressive and bidirectional language models against neural data
Why it matters
Provides a mechanistic understanding of why LLMs align with human neural processing by isolating the specific representational directions responsible for this alignment, potentially leading to more biologically plausible language models.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.