VoCa: Designing Speech-Canvas Interaction for Voice-Based Conversational Agents
What it is
This paper investigates how voice agents can coordinate speech with a visual canvas to support multi-turn conversations. It presents a design space derived from formative studies and details the development of VoCa, a prototype agent that manages visual object creation and attention guidance alongside dialogue.
The problem it solves
Current voice agents lack the ability to visually ground conversations, making it difficult for users to coordinate complex explanations, organize thoughts, or maintain shared context during multi-turn interactions.
What you could use it for
- Collaborative learning sessions where users sketch and speak simultaneously
- Work meetings involving shared visual notes and verbal discussion
- Daily life tasks requiring the organization of ideas through speech and drawing
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.