5 ms·
100 million reviews/year is only 3 reviews per second on average. Sure, they seem to do more then just that, like voting, comments, etc. But it still seems like
by z3t4 10y ago
100 million reviews/year is only 3 reviews per second on average. Sure, they seem to do more then just that, like voting, comments, etc. But it still seems like something an old school stack could handle on a single large instance.
Reading between the lines it seems the problem wasn't scaling, but programmer productivity. Smaller code bases is often easier to work with so I guess they solved that by dividing it up into many small services. The blog could use a more detailed description of the problem they are actually solving.
- nirmel 10y ago100 million is cumulative, not annual.
- joevandyk 10y agoTraffic is usually not averaged out.. it's spiky.
- falsedan 10y ago> 100 million reviews/year is only 3 reviews per second on average That's writes, I imagine the reads would be a bit higher.
- lumpypua 10y agoAnd ultimately, writes resulting from those reads. I imagine yelp has pretty stout analytics/metrics pipeline fed off views and conversion tracking.
- rlau26 10y agoThis. A lot of people look at apps like Instagram and Facebook, and think that they're simple to build and manage, when they don't realize that the part of the app the consumer directly interacts with on their screen is the tip of the iceberg when it comes to the entire business.
- eellpp 10y agoApplying the 80/20 principle: 80% of traffic occurs in the 20% of years time. Which is around 12 reviews per second. Still modest.
- ju-st 10y agoEven a Sqlite DB could handle this
- NhanH 10y agoNot entirely on topic, but is the 80/20 principle recursive?
- nsp 10y agoYes.
- thesimpsons1022 10y ago20 percent of it is 80 percent recursive
- discordance 10y agoAlso, 80% (often 90%) are reads and 10-20% are writes.
- TeMPOraL 10y agoWhenever I see headlines like these, "X billion messages per day/hour/second in some web service Y", I wonder what the hell is that service doing that it generates so much messages? I.e. I could understand Facebook, with its billion+ of users and built-in messaging platform, could generate billion of "messages" a day. But a mostly read-based service like Yelp? But I finally realized - those messages are probably mostly tracking, ads, more tracking, some infrastructure work and even more ads & tracking. The sausage machine that turns people into money.
- patrickmay 10y agoIndeed. I'm working in adtech and we get four billion requests for bids per day (more on Black Friday and the holiday season). Add in the ad serving and processing of all the results and it blows up fast.