4 ms·

Possibly behavoiral logs - A clicks on B's profile, views C's photo P1 and P2, plays game G1, chats with D and E.

• matrix 17y ago
  These are clickstream logs for sure. The guys at Facebook always talk about this Hadoop-based system in the context of analyzing users, rather than systems. I have been tempted to use Hadoop/Hive myself, but what I'm REALLY interested in is Yahoo's column-store DB, Everest. Being able to use SQL with these monster-sized data sets would open up a lot of possibilities.
  • jhammerb 17y ago
    Everest was replaced by Hadoop + Pig, Yahoo's take on a Hive-like system. Both Hive and Pig allow you to use SQL.
    • matrix 17y ago
      Hive and Pig are not SQL though. Yes, they're SQL-like, and do go some way towards solving that problem, but you won't be using things like standard DB libraries with them anytime soon.
      • jhammerb 17y ago
        Hive has ODBC and JDBC drivers. What SQL functionality are you missing?