Event-based Action Recognition by Pre-Training on Multi-Frame Representations
What it is
This paper proposes a method for action recognition using event cameras by introducing a multi-frame representation to handle long and complex event sequences. It utilizes a masked auto-encoding framework to pre-train a Vision Transformer, employing sparsity-aware masking and position-aware attention to improve performance and manage computational complexity.
The problem it solves
Frame-based event representations lose discriminative ability when processing long and complex event sequences, limiting the utility of event cameras for extended action recognition tasks.
What you could use it for
- Robotics navigation and interaction
- Patient monitoring in healthcare settings
- Privacy-preserving surveillance systems
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.