Rethinking Asymmetry in Self-Supervised 3D Geometry Learning
What it is
An arXiv paper proposing a self-supervised method for learning 3D geometry (depth and camera pose) from unposed images. Instead of enforcing the observation/explanation asymmetry in input space via separate branches or masked attention, it moves the asymmetry into the 3D representation space: a shared backbone sees all views for correspondence, while held-out views are excluded only from the reconstructed scene. It adds two extra training signals — aligning sparse-context features with dense-context features, and aligning features with a frozen vision foundation model — neither requiring geometric annotation.
The problem it solves
Prior self-supervised 3D-from-unposed-images methods avoid trivial solutions by restricting view interaction in input space (separate branches, masked attention), which limits the correspondence information the model can use and yields weaker geometry than the rendering objective alone would suggest.
What you could use it for
- Self-supervised pretraining of depth and camera-pose estimators from unposed image collections
- Improving downstream supervised 3D geometry training via self-supervised initialization
- Research baseline for comparing input-space vs. representation-space asymmetry designs in view-based 3D learning
Why it matters
If the reported gains hold, it offers a simpler asymmetry mechanism plus annotation-free training signals that improve depth and pose estimation over prior self-supervised methods and boost subsequent supervised training, potentially reducing reliance on posed or depth-annotated data.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.