OpenPA: Forced-alignment-free Multi-granular Pronunciation Assessment
What it is
OpenPA is a pronunciation assessment framework that leverages Whisper's cross-attention mechanism to predict word- and utterance-level scores without requiring forced alignment. It uses mixed-transcript adaptation to handle both closed and open-response settings within a single model, trained solely on the speechocean762 dataset.
The problem it solves
Existing automatic pronunciation assessment methods rely on complex multi-stage pipelines with forced alignment and separate feature extractors, limiting their practicality and adaptability across different response settings.
What you could use it for
- Assessing pronunciation in free-form speech responses
- Evaluating non-native speaker pronunciation without manual alignment
- Analyzing speech characteristics in medical contexts like oral-cancer speech
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.