HTTP traffic is different from run this CPU intensive pipeline service for 10 minutes and now increase the volume by 100x in a few months. I used to manage a p

HTTP traffic is different from run this CPU intensive pipeline service for 10 minutes and now increase the volume by 100x in a few months. I used to manage a popular app/website that had tens of billions of real user page views per month. It wasn't easy but it also wasn't hard. It was surprisingly easy with a single large Postgres DB, a lot of caching, optimized tables and queries.