FTA: > "WebArena is a standalone, self-hostable web environment for building autonomous agents. WebArena creates websites from four popular categories with fu

FTA: > "WebArena is a standalone, self-hostable web environment for building autonomous agents. WebArena creates websites from four popular categories with functionality and data mimicking their real-world equivalents. To emulate human problem-solving, WebArena also embeds tools and knowledge resources as independent websites. WebArena introduces a benchmark on interpreting high-level realistic natural language command to concrete web-based interactions. We provide annotated programs designed to programmatically validate the functional correctness of each task." The tasks are things like (an agent for github) "create a new repo" or (agent for ecommerce site) "add the cheapest item matching foo to shopping cart". Having a standard, isolated and realistic sandbox to train bots in is probably valuable to some. Interesting to see this side of the "prove you're human" arms race that's been escalating in the news lately.