PDRVLA: A Vision-Language-Action Model with Physical Dynamics Representations
What it is
PDRVLA is a Vision-Language-Action (VLA) model that improves robot control by incorporating a lightweight Physical Dynamics Module. This module extracts physical tokens from vision-language features to condition action generation, using direct prediction of future RGB, depth, and optical-flow features to avoid the high latency of online video generation.
The problem it solves
Existing VLA models have limited understanding of physical dynamics, and using video world models for this purpose introduces high latency into the robot control loop.
What you could use it for
- Robotic manipulation in simulated environments like LIBERO and RoboTwin
- Improving the physical understanding of VLA models for real-world robot control
- Training robot policies using publicly available data and human-to-robot synthesis
Why it matters
Enables more robust and physically grounded robot control by integrating dynamic scene understanding into VLA models without the computational overhead of real-time video prediction.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.