WebHarbor – We “dock” the real websites into local for web agents! [R]

“`html

Hello! Excited to share our latest community-driven research project: WebHarbor: Docking Real Websites for Evolving GUI Agent Environments. This initiative involves packaging 15 popular websites (like Amazon, GitHub, BBC News) into self-contained Flask + SQLite apps in a single Docker image. The control plane allows resetting each site to its original state in less than one second by human-in-the-loop coding agents like Claude Code or CodeX.

Why WebHarbor: Running web agent benchmarks on the live web is challenging due to factors such as reCAPTCHA, geo-blocking, content drift, and network issues. This project provides a lightweight, easy-to-reset environment for both evaluation and training of web agents, addressing these challenges by allowing controlled experiments without exposing real-world websites.

1. WebHarbor Project Page: Access detailed information about the project including how to contribute or review PRs.
2. HuggingFace Dataset: Utilize this dataset for further research and development on WebHarbor.
3. Contribute Guide: Learn how to create new mirror sites using a pipeline, human verification, and contributing to the final paper.

Welcome suggestions and discussions!

“`

“`html

“`

Originally published at reddit.com. Curated by AI Maestro.

Stay ahead of AI. Get the most important stories delivered to your inbox — no spam, no noise.

Please enable JavaScript in your browser to complete this form.

Name *

First

Last

Email Name

Email *

Submit