Towards Reliable AI Data Scientists: Data Agents with Workflow Harnesses
What it is
This paper introduces a taxonomy for Data Agents organized around five functional stages: perception, planning, execution, verification, and repair. It analyzes 15 technical approaches within these stages and identifies four open reliability problems that cause silent failures in automated data science workflows.
The problem it solves
General-purpose LLM agents lack the rigorous workflow harnesses needed for reliable, end-to-end data analysis, leading to persistent silent failures even when individual components function correctly.
What you could use it for
- Designing robust workflow harnesses for LLM-based data analysis agents
- Identifying reliability gaps in existing data agent architectures
- Benchmarking and evaluating the end-to-end data science lifecycle automation
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.