3 ms·

These are clickstream logs for sure. The guys at Facebook always talk about this Hadoop-based system in the context of analyzing users, rather than systems. I

by matrix 17y ago

These are clickstream logs for sure. The guys at Facebook always talk about this Hadoop-based system in the context of analyzing users, rather than systems. I have been tempted to use Hadoop/Hive myself, but what I'm REALLY interested in is Yahoo's column-store DB, Everest. Being able to use SQL with these monster-sized data sets would open up a lot of possibilities.

jhammerb 17y ago
Everest was replaced by Hadoop + Pig, Yahoo's take on a Hive-like system. Both Hive and Pig allow you to use SQL.
- matrix 17y ago
  Hive and Pig are not SQL though. Yes, they're SQL-like, and do go some way towards solving that problem, but you won't be using things like standard DB libraries with them anytime soon.
  - jhammerb 17y ago
    Hive has ODBC and JDBC drivers. What SQL functionality are you missing?