3 ms·
Scrapes are cached, it is too expensive and too long to do them on-demand based on a live query. Lots of sites change designs frequently and don't output semant
by rchaud 2y ago
Scrapes are cached, it is too expensive and too long to do them on-demand based on a live query. Lots of sites change designs frequently and don't output semantic code in the html source either. And good luck getting the customer to prompt correctly for things like background images, gradients, carousels, animations and page transitions.
- omneity 2y agoWe are actually solving this problem by building the Huggingface Hub[0] for browser automations -automatically tested and updated around the clock, and a homegrown distributed automation framework [1] that can leverage your own browser, your community’s or your team’s up to millions of orchestrated browsers. It’s not just for AI, we created a custom package format[2] for automations that can run in CLI as a one-off, a REST API server, an MCP server with a single command.. 0: https://herd.garden/trails https://herd.garden/trails 1: https://herd.garden https://herd.garden 2: https://herd.garden/docs/trails-automations https://herd.garden/docs/trails-automations