Kronecker-Structured Video Completion with Cross-Fitted Self-Supervised Residual Learning
What it is
This paper proposes a two-stage framework for tube-wise video completion that combines regularized masked Kronecker product decomposition with cross-fitted self-supervised residual learning. It estimates a structural backbone from observed data and uses a lightweight 3D CNN to predict corrections for missing tubes, ensuring exact data consistency.
The problem it solves
Standard video completion methods often suffer from a mismatch between in-sample fitting errors and prediction errors at missing tubes, leading to suboptimal reconstruction of unobserved spatial-temporal trajectories.
What you could use it for
- Reconstructing temporal trajectories at spatial locations unobserved in every video frame
- Filling in structured missing patterns in grayscale and RGB video sequences
- Improving video quality metrics like PSNR and SSIM in scenarios with high sampling rates
Why it matters
Provides a robust method for video completion that achieves state-of-the-art performance in both grayscale and RGB benchmarks, particularly in handling structured missing data and temporal consistency.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.