SplitJEPA: Learning Invariant and Variant Latent Worlds without Reconstruction
What it is
SplitJEPA is a Joint Embedding Predictive Architecture (JEPA) that learns the invariant and variant components of a latent state directly in representation space. It achieves this without using a reconstruction decoder, relying instead on theoretical guarantees for stationary Gaussian predictive dynamics.
The problem it solves
Existing methods for decomposing latent states into invariant and variant factors typically require reconstructing the entire observational world, which is computationally expensive and can introduce unnecessary biases or information loss.
What you could use it for
- Robotic manipulation tasks requiring robustness to camera shifts or lighting changes
- Learning representations for dynamical systems where specific factors must be distinguished from shared context
- Developing reconstruction-free latent state models for control and planning
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.