3 ms·
Absolutely fantastic notes, the standout ones to me: "They have had 7 significant revisions in 11 years" - This echos something I've learned in my own career.
by elblanco 16y ago
Absolutely fantastic notes, the standout ones to me:
"They have had 7 significant revisions in 11 years" - This echos something I've learned in my own career. You'll never ever ever ever get it right the first time. If you spend all of your time trying to get it right the first time, you'll never produce anything. BUILD! (but plan well to eliminate obvious mistakes).
"All their systems work well inside a datacenter, but have no way f spanning datacenters." - This was a real surprise. I guess I had mistakenly assumed that all of Google's distributed resources lived as one giant meta-machine. I never realized how disconnected the datacenters were.
"Don’t design to scale infinitely – consider 5X – 50X growth. But > 100X requires redesign << very insightful" - quote says it all.
- btilly 16y agoIf you care about latency, you can't abstract away the existence of data centers. The round trip speed of light means that that abstraction leaks too much.
- nostrademons 16y agoSuch a system could, in theory, abstract away the existence of data centers by optimizing for latency. Wherever the user is, perform the computation by using the copies of data that result in the lowest time spent hopping between DCs. And shard the data between DCs so that data that's frequently used together stays together, and data lives near its likely point of use, and replicas give good coverage of possible access points. Performing this calculation in a way that's faster than just going and fetching the data is left as an exercise to the reader. And Jeff Dean.