Axon DSL for LLM Architectures
What it is
Axon is a strongly typed domain-specific language (DSL) with Haskell-like syntax designed to define Large Language Model (LLM) architectures. It enables a 'write-once, run-everywhere' approach by automatically compiling model specifications into optimized implementations for multiple frameworks including PyTorch, JAX, MLX, and vLLM.
The problem it solves
The high resource cost and complexity of maintaining and translating model definitions across different training and inference regimes.
What you could use it for
- Defining and deploying LLM architectures across multiple backends (e.g., JAX, PyTorch, MLX) without rewriting code.
- Creating highly specialized model architectures with auditable, concise specifications.
- Optimizing inference performance by generating native vLLM architectures with PagedAttention and KV-cache.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.