3 ms·
Okay, great point, but who will pay for that? Serving content costs money: traffic, extra load on CPU and storages, and now on serverless functions too. One sp
by SergeAx 6y ago
Okay, great point, but who will pay for that? Serving content costs money: traffic, extra load on CPU and storages, and now on serverless functions too.
One spider may be equivalent of hundreds of real users. And it spoils caches too.
- emiliobumachar 6y agoCrackpot regulation proposal: scraping is legal if you favor mirror sites and afterwards create a mirror yourself and maintain it to some arbitrary standard.