YANAMI: Multimodal Dataset and Benchmark for Multiturn Stateful Interaction
What it is
YANAMI is a proposed large-scale multimodal dialogue dataset (YANAMI-400K) plus an evaluation benchmark (YANAMI-Bench) aimed at multi-turn, stateful interaction for Unified Multimodal Models. YANAMI-400K contains 400K multi-turn multimodal dialogues spanning over 2M images and 2.6M dialogue turns across four scenarios: Multi-Image Fusion, Image Editing, World Modeling, and Visual Reasoning, where later turns depend on state carried from earlier ones. YANAMI-Bench provides 400 multi-turn dialogues that jointly score Dialogue State Understanding and Visual Realization; the authors report that fine-tuning BAGEL on YANAMI-400K improves image editing, generation, and stateful interaction by 10.3%, 2.0%, and 13.23% respectively.
The problem it solves
Existing unified multimodal datasets and benchmarks are dominated by single-turn tasks, and even recent multi-turn sets contain turns that can be solved independently, so they give little supervision or evaluation for maintaining, updating, and faithfully realizing an evolving multimodal dialogue state.
What you could use it for
- Fine-tuning unified multimodal models on multi-turn, state-dependent dialogue data
- Benchmarking models on whether they preserve and update dialogue state across turns
- Measuring the gap between understanding an evolving dialogue state and actually rendering it in images
- Research on multi-image fusion, iterative image editing, world modeling, and visual reasoning
Why it matters
If the dataset and benchmark hold up, they would give the multimodal community a shared, stateful multi-turn training and evaluation resource, shifting work away from single-turn tasks and exposing where current unified models fail to carry dialogue state into visual output.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.