Linguistic Loopholes in LLM Unlearning: From a 174-Language Benchmark to Coverage-Aware Unlearning
What it is
This paper identifies a cross-lingual loophole in LLM unlearning where forgetting a fact in one language fails to remove it in others. It introduces the Cross-Lingual Unlearning Tensor, a benchmark spanning 174 language-script pairs, and proposes COVER, a method that selects a subset of source languages to maximize erasure coverage under a language budget.
The problem it solves
Unlearning a fact in one language does not guarantee its removal in others, and unlearning in all languages is not scalable and damages unrelated model capabilities.
What you could use it for
- Selecting optimal source languages for unlearning to ensure cross-lingual forgetting
- Benchmarking the robustness of unlearning methods across diverse linguistic expressions
- Reducing the computational cost of multilingual unlearning by avoiding training on all languages
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.