3 ms·
> Most of it can be retrieved manually, but not with a script that runs regularly this may be down to ability of the script or its author. most things retrieva
by 867-5309 6y ago
> Most of it can be retrieved manually, but not with a script that runs regularly
this may be down to ability of the script or its author. most things retrievable manually are retrievable by scripts, bots, scrapers, etc.
the bigger data captors also provide APIs which can help to a degree, and where limits are imposed there are usually workarounds
- nicbou 6y agoSure, but it's hard to build something reliable and long-lasting that relies on scraping websites that actively try to prevent scrapers. It's not that I can't build it, but rather that I won't.