4 ms·
There is this article: http://developer.yahoo.com/blogs/hadoop/posts/2008/09/scaling_hadoop_to_4000_nodes_a/ http://developer.yahoo.com/blogs/hadoop/posts/2008
by 0x12 15y ago
There is this article:
http://developer.yahoo.com/blogs/hadoop/posts/2008/09/scaling_hadoop_to_4000_nodes_a/ http://developer.yahoo.com/blogs/hadoop/posts/2008/09/scalin...
Which is from 2008 and which references a cluster twice the size of the facebook one, and mentions several production clusters the same size as the facebook one.
They are (obviously, this being Yahoo!) not on Amazon though.
- al_james 15y agoDefine bigger? More nodes yes, but less cores, RAM and disk space.
- DanielRibeiro 15y agoFrom the article: That's a total of more than 21 PB of configured storage capacity! This is larger than the previously known Yahoo!'s cluster[1] of 14 PB. Guess they are comparing data volumes. But great for pointing out that they do not have the largest in machine count. [1] http://developer.yahoo.com/blogs/hadoop/posts/2010/05/scalability_of_the_hadoop_dist/ http://developer.yahoo.com/blogs/hadoop/posts/2010/05/scalab...