3 ms·
AWS Lambdas are an easy way to get scheduled scraping jobs running. I use their Python-based chalice framework (https://github.com/aws/chalice https://github.c
by turtlebits 6y ago
AWS Lambdas are an easy way to get scheduled scraping jobs running.
I use their Python-based chalice framework (https://github.com/aws/chalice https://github.com/aws/chalice) which allows you to add a decorator to a method for a schedule,
@app.schedule(Rate(30, unit=Rate.MINUTES))
It's also a breeze to deploy.
chalice deploy