I've noticed a healthy amount of websites with pretty granular RSS, for example the auto parts outlet rockauto.com has RSS feed for every make, model, and prod

I've noticed a healthy amount of websites with pretty granular RSS, for example the auto parts outlet rockauto.com has RSS feed for every make, model, and production year that they service. I'd wager this saves them some unpaid overtime. It seems that a service which provides correct, useful RSS nearly obviates the entire hassle of dealing with bot scrapers and the resource drain and health insurance premiums that come along. You can easily serve any volume of RSS with cloudflare or nginx. It is quite true that mobile clients scraping a url is inefficient vs pub/sub. Maybe you could just uses mqtt to trigger a GET or something. I spent about five minutes considering what a world with facebook, instagram, ebay, amazon RSS feeds might look like. The experience felt like goat staring.