2 ms·
From a few weeks ago: https://news.ycombinator.com/item?id=49500040 https://news.ycombinator.com/item?id=49500040 Basically, the cost of an optimized solution
by stickfigure 10d ago
From a few weeks ago: https://news.ycombinator.com/item?id=49500040 https://news.ycombinator.com/item?id=49500040
Basically, the cost of an optimized solution is orders of magnitude lower than the cost of an in-browser solution. Anyone dedicated can easily afford to solve workloads higher than your users will tolerate.
You might stop casual scrapers, but you're not going to stop someone who cares. AI scraping companies care.
- hedora 10d ago[dead]
- murderfs 10d agoThat's not even the fundamental problem. Even if the payload runs optimally in the browser, the cost of CPU is so small that it's basically irrelevant. If you waste your user's time with something that would take a full minute to run on a datacenter core, you're costing the scraper something like $0.000005: 360 W TDP on a 128-core EPYC 9754 * $0.10/kWh. In reality, it'll be substantially less than that, because CPUs don't use 0W at idle. The only way this would make any sense is if there were many more scrapers than users and scrapers cared more about latency than real users, but that's the exact opposite of reality. The entire endeavor is so fundamentally misguided that it almost seems like a psyop.
- mitxela 10d agoYou're assuming that the part of Anubis that stops bots is the PoW. It's not.
- account42 10d agoThe other parts are even more trivial for someone who cares to work around.
- mitxela 10d ago"someone who cares" is the part that creates the firewall.
- stickfigure 10d agoWith modern AI tools, the amount you have to care is slight. Not much of a firewall. And the bad actors causing these scraping problems care a lot.
- mitxela 9d agoStill have to care enough to run the ai