Asynchronous Flow Map Language Models
What it is
This paper introduces asynchronous flow map language models (aFMLMs) to improve one-step parallel language modeling by incorporating token prediction order. It learns flow maps of asynchronous flows that use tokenwise time schedules to control denoising progress, allowing all tokens to be generated in a single forward pass.
The problem it solves
Standard one-step parallel language models struggle to exploit token prediction orderings, leading to lower quality compared to iterative autoregressive or masked diffusion approaches.
What you could use it for
- One-step parallel generation of text sequences
- Solving Sudoku puzzles
- Generating code for math word problems like GSM8K
Why it matters
Enables high-quality sequence generation in a single forward pass, potentially significantly reducing inference latency compared to autoregressive models while maintaining or improving quality on specific tasks.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.