Duration Commonsense Reasoning with Human-LLM Co-annotations
What it is
This paper investigates whether vision-language models can infer the duration of human activities (e.g., living vs. staying) from social media posts. It introduces a new corpus of geotagged tweets co-annotated by humans and LLMs to evaluate this capability, finding that current models struggle with integrating contextual cues.
The problem it solves
Duration is rarely explicitly stated in social media posts, making it difficult for models to infer whether a user is living, staying, or just visiting a location based on noisy textual and visual cues.
What you could use it for
- Evaluating the commonsense reasoning capabilities of vision-language models
- Understanding human mobility and travel behavior from social media data
- Benchmarking multimodal models on context-aware duration inference
Why it matters
Identifies specific failure modes in current VLMs regarding contextual integration, providing a targeted benchmark to drive improvements in multimodal understanding of human behavior.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.