EarthVerse: Benchmarking Scientific Agents Across Dynamic Earth Systems and Natural Hazards
What it is
EarthVerse is a benchmark for evaluating scientific agents on complex Earth-system analysis tasks. It consists of 405 reproducible tasks grounded in 199 documented natural hazard events, requiring agents to inspect heterogeneous evidence, perform calculations, and maintain provenance.
The problem it solves
Current scientific agents struggle to maintain a consistent chain of reasoning across heterogeneous evidence, scales, units, and physical interpretations, leading to unreliable end-to-end scientific analysis.
What you could use it for
- Evaluating the reliability of LLM agents in scientific research workflows
- Benchmarking agent performance on multi-step Earth system analysis
- Assessing agent capabilities in evidence reconciliation and provenance tracking
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.