WebHarbor: Docking Real Websites for Evolving GUI Agent Environments
What it is
WebHarbor is a proposed suite of 153 executable, dockerized website environments that reconstruct the visual interfaces, content, and functional workflows of real web services under deterministic control. Environments are built via task-driven human-agent collaboration, where new tasks expand functional scope, coding agents implement changes, and humans audit fidelity and correctness. The suite contains 3,518 tasks spanning multi-step and post-authentication workflows, and is also positioned as a high-fidelity environment for cost-efficient RL training of GUI web agents.
The problem it solves
Live website evaluation is unstable due to changing content, access restrictions, and poor coverage of authenticated workflows, while existing synthetic training environments lack functional depth and visual fidelity.
What you could use it for
- Deterministic evaluation of GUI web agents on multi-step web tasks without live-site drift
- Benchmarking agents on post-authentication workflows that live-site evaluation cannot cover
- Reinforcement learning training of GUI web agents in reproducible synthetic web environments
- Reproducing and comparing agent results across four benchmarks with a fixed environment suite
Why it matters
If it works as described, it would give GUI web agent research a stable, reproducible alternative to live-site evaluation and shallow synthetic environments, enabling both fairer benchmarking and cheaper RL training that generalizes to unseen tasks.
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.