Jumping the Line: Exploiting Length Predictions in LLM Scheduling
What it is
This paper introduces JIL, an adversarial attack on LLM serving schedulers that rely on predicted output lengths for prioritization. By optimizing an adversarial suffix, JIL causes lightweight length probes to significantly underestimate the request's true length, allowing malicious requests to jump the queue and complete faster than benign ones.
The problem it solves
Practical LLM schedulers must estimate output length to prioritize requests, but this estimation signal can be manipulated by malicious users to gain unfair priority and reduced latency, degrading service for benign users.
What you could use it for
- Security auditing of LLM serving infrastructure
- Designing robust scheduling policies that resist adversarial manipulation
- Evaluating the trade-off between scheduling efficiency and response quality under adversarial conditions
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.