DuoMind: Distributed Multi-Robot Coordination with Semantic Communication
What it is
DuoMind is a distributed hierarchical framework that enables multi-robot coordination by combining Vision-Language-Action (VLA) models for low-level execution with Vision-Language-Model (VLM) orchestrators for high-level reasoning. It facilitates inter-agent communication through semantic messages generated by the VLMs, allowing robots to coordinate long-horizon tasks while maintaining precise local control.
The problem it solves
Existing VLM/VLA progress is limited to single-robot settings, making it difficult to extend these capabilities to multi-robot systems that require coordinated long-horizon behaviors and reliable fine-grained execution.
What you could use it for
- Coordinating multiple robots for complex, long-horizon manipulation tasks
- Distributed robotic systems requiring reliable, fine-grained execution and high-level planning
- Benchmarking multi-robot coordination capabilities using the RoboPoly dataset
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.