2 ms·
This can be great for scrapping jobs! There are IP-based rate limiters on sites (linkedIn, facebook, etc), but each lambda has a new public IP so by using faas
by asadlionpk 7y ago
This can be great for scrapping jobs!
There are IP-based rate limiters on sites (linkedIn, facebook, etc), but each lambda has a new public IP so by using faast.js, I can stay under the radar.
Plus you can essentially spawn a headless chrome (puppeteer) to do advanced stuff.
- achou 7y agoIndeed, I've put together a simple example of using puppeteer with faast.js in this repo: https://github.com/faastjs/examples/tree/master/aws-puppeteer-ts https://github.com/faastjs/examples/tree/master/aws-puppetee...