DataKernelBench: Can LLMs Optimize Database Queries on GPUs?
What it is
This paper introduces DataKernelBench, a benchmark that evaluates LLMs' ability to optimize database queries on GPUs by translating SQL into PyTorch TorchPlan programs. It tests models on TPC-H workloads using CUDA and Triton, measuring speedups against torch.compile and analyzing the impact of kernel fusion and execution strategies.
The problem it solves
Existing LLM kernel benchmarks focus on machine learning operators, leaving irregular, heterogeneous, and data-movement-heavy database-style operators untested, while peak database performance on GPUs still relies on hand-written kernels.
What you could use it for
- Evaluating LLMs for automatic GPU kernel generation for database systems
- Benchmarking code optimization capabilities for irregular, data-movement-heavy operators
- Assessing the effectiveness of execution-guided repair in LLM-generated CUDA/Triton code
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.