3 ms·

I'm surprised the authors of this article completely missed the many extended query languages specially made to process large sets of data, published in top com

I'm surprised the authors of this article completely missed the many extended query languages specially made to process large sets of data, published in top computer science conferences by Google, Microsoft, and Yahoo. Microsoft has SCOPE: http://portal.acm.org/citation.cfm?id=1454159.1454166 http://portal.acm.org/citation.cfm?id=1454159.1454166 Yahoo has Pig: http://portal.acm.org/citation.cfm?id=1376726 http://portal.acm.org/citation.cfm?id=1376726 Google has Sawzall: http://iospress.metapress.com/content/99vjkgkae3jkvu9t/ http://iospress.metapress.com/content/99vjkgkae3jkvu9t/

mark_l_watson 16y ago
It might just be my limited experience with Pig, but I really prefer coding up Hadoop map-reduce applications by hand (using Ruby or Java, depending on the app). Tools like Cascading and Cascalog look nice, and I have experimented with them, but I still like bare-metal map reduce. (BTW, I have been spending most of my time lately writing Hadoop apps).