4 ms·
There is one thing that Google has done well that no other company (Amazon, Microsoft, Facebook) seems to understand. Hire experts. They call this hire Ph.D.'s,
by locacorten 15y ago
There is one thing that Google has done well that no other company (Amazon, Microsoft, Facebook) seems to understand. Hire experts. They call this hire Ph.D.'s, but that's slightly inaccurate because having a Ph.D. does not make you an expert. They understand that building systems at large scale requires people who have a deep understanding of distributed systems that goes much beyond "My code is on SourceForge" mentality, or "Git is better than SVN because it is a distributed repository".
To this day, I am still shocked as to how many devs have no clue on what I'm talking about, yet they are in charge of Internet-scale systems. Here's a list of symptoms, I've heard over the years:
- I'll put something quick together.
- I implemented Paxos last night.
- I found an optimization in the two-phase commit protocol.
In my opinion, being expert means becoming humble and doubtful about your code when implementing large-scale systems. If your code runs on thousands of machines and serves 100K+ people and you think you rock as a developer/architect then you're doing something wrong.
Facebook doesn't get this. Look at their systems. They barely work. Good thing it doesn't matter. Yet. But it will eventually.
Amazon gets a little of this. Bringing Werner showed signs that they started to get it. They are still in this mix where a small group of people gets it and continues to bring in experts and push amazing things out. We'll see how long this will last.
Microsoft clearly doesn't get it. But that's ok, because they have no Internet-scale systems anyway. They built MSR which is capable of building such systems, but they make sure MSR remains isolated from their code. MSR seems happy to have no role in the company and to continue to publish amazing research.
- bretpiatt 15y agoMicrosoft clearly doesn't get it. But that's ok, because they have no Internet-scale systems anyway. Serious Microsoft hyperbolic bashing. The facts: Hotmail: 369 million users, Gmail: 193 million ( around the end of 2010, does anyone have newer numbers? http://www.email-marketing-reports.com/metrics/email-statistics.htm http://www.email-marketing-reports.com/metrics/email-statist... ) Bing, 5PB per container: http://www.flickr.com/photos/scobleizer/4870003098/ http://www.flickr.com/photos/scobleizer/4870003098/ Lots of containers, "Microsoft's online operation puts big data into perspective. Bing's infrastructure is comprised of 250,000 Windows Server machines and manages some 150 petabytes of data. Microsoft processes two to three petabytes per day. "You really have to figure out how to process that kind of data to keep your index fresh," Nardella says." ( http://www.informationweek.com/news/software/bi/230700013 http://www.informationweek.com/news/software/bi/230700013 ) I could continue to go on but Microsoft is clearly running Internet-scale systems.
- shriphani 15y agoI am pretty sure MSR's work makes it to consumer products (Trueskill for XBox + Bing definitely get MSR input and there's the PL division which has some top PL researchers) But doing Computer Science for the sake of Computer Science is a good thing. It would be a shit world if all fundamental CS research was driven by problems of scale.