3 ms·
this was a game changer for us -- instead of everyone contending for the Hadoop cluster, each developer has their own personal arsenal of Hadoop clusters. huge
by derwiki 16y ago
this was a game changer for us -- instead of everyone contending for the Hadoop cluster, each developer has their own personal arsenal of Hadoop clusters. huge win.
- timr 16y agoderwiki forgot to add that we need help wrangling our boatloads of data. We're hiring engineers: http://www.yelp.com/careers http://www.yelp.com/careers
- bravura 16y agoBut then don't you have a lot of CPUs going unused, because you are partitioning your resources? Is it really difficult to automatically allocate shared resources?
- timr 16y agoWe're allocating EMR clusters as needed. When they're no longer needed, they go away. Waste is minimal.
- stevejohnson 16y agoThanks for showing this to us at CWRU! It has already given me hours of fun. (See my top-level post about a py3k port.)