GRACE: Generation-aware latent compression for efficient video generation
What it is
GRACE is a two-stage framework that compresses pretrained video autoencoders while maintaining compatibility with existing Diffusion Transformers (DiTs). It works by learning a residual latent for information lost during compression and aligning the compressed latent with the original in the DiT's feature space, followed by lightweight fine-tuning of the DiT.
The problem it solves
Highly compressed video autoencoders typically degrade reconstruction quality and shift the latent distribution, forcing expensive retraining or adaptation of the Diffusion Transformer to maintain generation quality.
What you could use it for
- Accelerating inference for large video diffusion models like Wan2.1-I2V-14B
- Reducing computational latency for high-resolution video generation
- Compressing video autoencoders without requiring full retraining of the diffusion model
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.