2 ms·
They also suggest maybe “proof of React” would be better with a link to this rough proof of concept: https://github.com/TecharoHQ/anubis/pull/1038 https://gith
by MBCook 1y ago
They also suggest maybe “proof of React” would be better with a link to this rough proof of concept:
https://github.com/TecharoHQ/anubis/pull/1038 https://github.com/TecharoHQ/anubis/pull/1038
Could someone explain how this would help stop scrapers? If you’re just running the page JS wouldn’t this run too and let you through?
- fluoridation 1y agoLow-effort scrapers don't run JS, they just fetch static content.
- MBCook 1y agoBut then they couldn’t get past the current Anubis. Sonia the idea it would just be cheaper for clients?
- fluoridation 1y agoThat's the idea. Impose software requirements on the client instead of computational requirements.
- ranger_danger 1y agoThey admitted that this was a 'shitpost'. > how this would help stop scrapers I think anubis bases its purpose on some flawed assumptions: - that most scrapers aren't headless browsers - that they don't have access to millions of different IPs across the world from big/shady proxy companies - that this can help with a real network-level DDoS - that scrapers will give up if the requests become 'too expensive' - that they aren't contributing to warming the planet I'm sure there does exist some older bots that are not smart and don't use headless browsers, but especially with newer tech/AI crawlers/etc., I don't think this is a realistic majority assumption anymore.