4 ms·
> 5 orders of magnitude too small for another. Nitpick on an otherwise good post, but I don’t think there are very many 6billion RPS systems out there, and tho
by zbentley 3mo ago
> 5 orders of magnitude too small for another.
Nitpick on an otherwise good post, but I don’t think there are very many 6billion RPS systems out there, and those that do exist are almost certainly using bespoke, purpose-built tools
- 10000truths 3mo agoCould be base 2. ~1.3M RPS is a lot higher than most will ever require, but still within the realm of possibility.
- jerf 3mo agoFair.
- odo1242 3mo agoThe highest I could think of is WhatsApp, which gets ~1.6 million RPS on average, and they use MQTT
- znpy 3mo agoDynamoDB scales much more than that. In one of their dynamodb papers they claimed that the amazon us retail website alone made like 89 millions rps during prime day, a few years ago.
- deleted 3mo ago[deleted]
- junon 3mo agoIt's also one of the most aggravating database systems I've worked with.
- znpy 3mo agoIt still scales though
- dynotable 3mo ago89M rps was the peak across all Amazon systems during 2021 Prime Day. Alexa, Amazon.com and the fulfilment centres together, not one site. But its still very impressieve. But the more importarnt number is the per partition limit, 3000 RCU and 1000 WCU. Horizontal scale is the easy part, a table only gets near it if the partition key actually spreads.
- stingraycharles 3mo agoI work in manufacturing, you would be surprised at the volumes of sensor data being processed there for predictive maintenance. MQTT is everywhere, indeed, because of how simple the protocol is (it’s very ubiquitous in IoT / embedded systems).
- illliillll 3mo agoI used to scrape Meta sites at over 200k steady rps for a couple of years, all by myself. They did send lawyers to my door in the end though. Someone had forgot IPv6 rate limit bucketing :)
- dr_dshiv 3mo agoTell more sounds like a good story
- deleted 3mo ago[deleted]
- coreylane 3mo agoAWS IAM handles over 1.2 billion requests per second, based on a 2024 post, im sure its higher now https://aws.amazon.com/blogs/security/an-unexpected-discovery-automated-reasoning-often-makes-systems-more-efficient-and-easier-to-maintain/ https://aws.amazon.com/blogs/security/an-unexpected-discover...
- odo1242 2mo agoAh, interesting.
- nly 3mo agoWhatsApp is primarily 1 to 1 messaging. Why would this be hard to scale? Scaling horizontally, sharding, and message routing is all it takes, surely?
- odo1242 3mo agoWasn't saying it would be hard to scale at all, I just mentioned the highest RPS customer-facing system I could think of off the top of my head.
- monster_truck 3mo agoMaybe there would be more if it were more straightforward to do so?
- ndriscoll 3mo agoFor reference, I've seen Visa marketing materials that suggest their network can do ~70k TPS. There are not very many systems one could conceive of that could do useful work 1/s for ~every human on the planet.
- chmod775 3mo ago> There are not very many systems one could conceive of that could do useful work 1/s for ~every human on the planet. Roughly a hundred servers on 100 GbE ports each could handle one small UDP packet per human every second, and would have a plenty of cycles and RAM per human left to actually do some work. That fits in a shipping container. Illustrative of course: the point is that "for every human" is not far out there given how crazy powerful hardware has become.
- AdieuToLogic 3mo ago>> For reference, I've seen Visa marketing materials that suggest their network can do ~70k TPS. > Roughly a hundred servers on 100 GbE ports each could handle one small UDP packet per human every second ... While there is no correlation between the Visa claim of 70k tps to people on the planet, there is also no correlation to the number of servers needed to process UDP packets. The "Visa network" is more of a trusted collaboration between a small number of banks operating multi-step transactions than it is an OSI Layer 1 - 5 concern.
- chmod775 3mo ago> Illustrative of course: the point is that "for every human" is not far out there given how crazy powerful hardware has become.
- ksec 3mo ago