3 ms·
Amazon's scale encounters limits that most companies don't ever have to consider. There's a parallel from 20ish years ago: Amazon eschewed software performance
by femto113 4y ago
Amazon's scale encounters limits that most companies don't ever have to consider. There's a parallel from 20ish years ago: Amazon eschewed software performance engineering with the mantra "if it can be solved with a credit card [i.e. you can buy more hardware] don't worry about it now". That worked up to the day they called the company that made their database server and asked to upgrade and were told "you already have the most powerful machine we've ever built".
- pojzon 4y agoIn single master architecture this is inevitable. At some point you wont be able to throw more hardware. Thats why multi-master architecture was created in the first place.
- toast0 4y agoA lot of big companies went through that, I've seen presentations about eBay running out of scaling room on their Oracle servers in their boom. Otoh, maximum database server today is a ton bigger. Looking at just Supermicro, you can get 8 TB ram in a dual Epyc server, and 24 TB in exotic, but still off the shelf systems. You can get a lot of qps with 24 TB of ram and a whole bunch of cores. If you go with Oracle, they'll sell you a Sparc server with 48 TB of ram, and 384 CPU cores.
- scollet 4y agoSingle "manager" or "distributor" you mean