AVSD-Scenes: A Dataset for Audio-Visual Description of Urban Scenes
What it is
This paper introduces AVSD-Scenes, a dataset of 12,291 paired audio-visual scene descriptions for urban environments. It is constructed by generating modality-specific descriptions using Qwen2-Audio-7B and Qwen2.5-VL-7B, then combining them with large language models to create unified multimodal descriptions.
The problem it solves
The lack of datasets that jointly describe both auditory and visual information in urban environments, limiting the development of multimodal AI systems.
What you could use it for
- Training models for joint audio-visual understanding
- Improving cross-modal retrieval in urban scene analysis
- Enhancing semantic alignment between audio and visual data
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.