VIGOR: Zero-Shot Visual Generalization in MBRL
What it is
VIGOR is a framework for model-based reinforcement learning that improves robustness to unseen visual distractions like lighting changes and background shifts. It achieves this by enforcing consistency in the latent space through asymmetric augmentation, dynamics-level consistency, and encoder stabilization, allowing the agent to generalize without retraining on new visual conditions.
The problem it solves
Model-based RL agents suffer from compounded errors when visual distractions push encoder outputs out of distribution, leading to significant performance degradation during recursive latent rollouts.
What you could use it for
- Training robotic agents that must operate in environments with variable lighting or camera angles
- Improving the sample efficiency of model-based RL agents in visually complex simulation tasks
- Developing zero-shot generalization strategies for vision-based control systems
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.