MedPhysBench: A Benchmark for Evaluating Language Models on Medical Physics Calculations
What it is
MedPhysBench is a benchmark designed to evaluate the ability of large language models to perform medical physics calculations and detect errors in peer reviews. It uses seeded generators to create calculation and error-detection tasks across radiation therapy, diagnostic imaging, and nuclear medicine, grading responses against reference answers derived from governing protocols.
The problem it solves
Lack of specialized benchmarks to verify if LLMs can accurately perform complex medical physics calculations and reliably detect errors in peer-reviewed clinical worksheets.
What you could use it for
- Evaluating LLM performance on radiation therapy dose calculations
- Testing model ability to detect planted errors in medical physics worksheets
- Benchmarking models on nuclear medicine and radiation protection tasks
Why it matters
Provides a rigorous, protocol-based standard for assessing the safety and reliability of LLMs in critical medical physics workflows, helping identify specific failure modes like omitted inverse-square corrections.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.