LapMerge: Differentiable Exact-Budget Token Merging
What it is
LapMerge is a differentiable token merging operator that partitions sequences into exactly N equal-mass segments using a Laplace-kernel density. It achieves linear time complexity for both forward and backward passes, allowing for exact output budget control without sacrificing information preservation.
The problem it solves
Existing token compression methods face a trade-off between preserving information and computational efficiency, often requiring expensive pairwise matching or non-differentiable selection.
What you could use it for
- Reducing sequence length in vision transformers
- Compressing token sequences in vision-language models
- Implementing efficient token reduction in long-context LLMs
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.