4 ms·

Just discovered your article “Introduction to web testing and scraping” and will try it out. Exactly had the problem of scaling last time I tried out to run sev

• alexellisuk 6y ago
  Do you mean https://www.openfaas.com/blog/puppeteer-scraping/ https://www.openfaas.com/blog/puppeteer-scraping/ ? There are more traditional tools and SaaS services based around the web-driver model, which might be useful for folks who don't want to get into infrastructure, and don't want the latency of using Lambda. In testing I saw 15s+ for visiting a simple website that took 1-2s locally in a container. Feel free to give the content a try and let us know how it goes for you? OpenFaaS can also run these tasks async and queue them up / process from a queue.