I've worked on multiple sites like this over my career. Our pages were expensive to generate, so what scraping did is blew out all our caches by yanking cold p

I've worked on multiple sites like this over my career. Our pages were expensive to generate, so what scraping did is blew out all our caches by yanking cold pages/images into memory. Page caches, fragment caches, image caches, but also the db working set in ram, making every single thing on the site slow.