Scraping is a short term anomaly. The hype cycle is already dying which quickly reduces the amount of resources devoted to such efforts. Where I think that pos

Scraping is a short term anomaly. The hype cycle is already dying which quickly reduces the amount of resources devoted to such efforts. Where I think that post failed is poisoning the well of anyone ignoring Robots.txt is arguably a moral imperative. That post was concerned with wasting kWh, but ensuring that bad actors don’t profit discourages people from being bad actors.