There's two distinct problems caused by AI scrapers: 1. Bandwidth consumption - that's on scrapers downloading multimedia files 2. CPU resource exhaustion - A

There's two distinct problems caused by AI scrapers: 1. Bandwidth consumption - that's on scrapers downloading multimedia files 2. CPU resource exhaustion - AI scrapers don't take contextual clues into account. They just blindly follow each and every link they can find, which means that they hit a lot of pages that aren't cached but re-generated for each call. That's stuff like the article history but especially the version delta pages. These are very expensive to generate and are so rarely called that it doesn't make sense to cache them.