Discovering Interpretable Acoustic Features in Autoregressive Voice-Cloning TTS Models
What it is
This paper introduces a feature-based interpretability framework to analyze how autoregressive voice-cloning TTS models represent acoustic properties. It uses sparse autoencoders, PCA, and random directions to probe and steer models like Qwen3-TTS, revealing that while models encode concepts like pitch and accent, the effectiveness of probing and steering varies significantly across different concepts and architectures.
The problem it solves
It remains unclear which specific acoustic properties autoregressive voice-cloning TTS models represent and use to synthesize speech.
What you could use it for
- Understanding which acoustic features drive voice cloning in TTS models
- Identifying interpretable features for controlling speech synthesis output
- Comparing interpretability methods across different TTS architectures
Why it matters
Provides a systematic method for understanding the internal representations of voice-cloning models, potentially enabling more controllable and transparent speech synthesis.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.