4 ms·
I used to work for a very large financial institution. Scraping from finance apps was a material source of load even with substantial countermeasures in place.
by jcims 3y ago
I used to work for a very large financial institution. Scraping from finance apps was a material source of load even with substantial countermeasures in place. I can’t imagine what it does to sites like Twitter and Reddit (and HN).
- aledalgrande 3y agoHN has an open API look at the footer
- oefrha 3y agoHN volume is absolutely tiny (the ids are sequential so you can easily check how many items there are in a given day) and there’s an API. It’s no comparison.