Diffusion Language Models for Perplexity-Aware Black-Box Attacks
What it is
This paper proposes using continuous diffusion language models (dLLMs) to generate natural-language prompts for black-box attacks on LLMs. It replaces the random mapping used in previous continuous-space attacks with a learned generative distribution, significantly reducing prompt perplexity while preserving the standard-Gaussian latent formulation for sampling or optimization.
The problem it solves
Existing continuous-space black-box attacks produce highly unnatural prompts due to unlearned random mappings, making them easily detectable by input guardrails and yielding ungrounded risk estimates.
What you could use it for
- Generating high-quality, low-perplexity adversarial prompts for evaluating LLM safety
- Improving the realism of black-box attack simulations to better estimate model risk
- Developing perplexity-aware guardrails that can detect unnatural adversarial inputs
Why it matters
If successful, this approach makes black-box attacks more realistic and harder to detect via simple perplexity-based guardrails, providing a more accurate assessment of LLM vulnerabilities to malicious behaviors like overthinking.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.