Generative Representation Learning for Scalable Latent Tokenization
What it is
This paper proposes a self-supervised representation learning method that uses generative modeling to create latent tokens for downstream tasks. It addresses issues like dimensional collapse in existing methods by using pointwise mutual information factorization and demonstrates improved compute efficiency for image generation.
The problem it solves
Common self-supervised representation learning methods like DINO and LeJEPA suffer from dimensional collapse and feature suppression, and existing tokenizers are not compute-optimal compared to direct pixel-space generation.
What you could use it for
- Training efficient latent tokenizers for image generation models
- Improving the FID scores of diffusion models by using better latent representations
- Scaling representation learning with predictable compute benefits
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.