SpecSlot: Role-Coupled Tokenization for Pixel-Space Generative Transformers
What it is
This paper introduces SpecSlot, a pixel-space rectified-flow Transformer that decouples output detail from global attention length by assigning disjoint DCT coefficient bands to multiple slots per spatial anchor. It allows high-frequency details to be modeled locally while only low-frequency slots participate in global attention, reducing computational costs for high-resolution image generation.
The problem it solves
Standard pixel-space generative Transformers require more tokens for finer detail, making global attention increasingly expensive and limiting the scalability of high-resolution image generation.
What you could use it for
- High-resolution image generation with reduced computational cost
- Text-to-image synthesis requiring fine-grained detail without excessive global attention overhead
- Optimizing pixel-space generative models for efficiency
Why it matters
Enables more efficient training and inference of high-resolution pixel-space generative models by significantly reducing FLOPs while maintaining or improving image quality metrics like FID and DPG-Bench scores.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.