4 ms·
Anyone know why they built this rather than use Hive or Pig? One thing that drives me nuts is that all of these MR tools are very slow because they don't take a
by matrix 17y ago
Anyone know why they built this rather than use Hive or Pig? One thing that drives me nuts is that all of these MR tools are very slow because they don't take advantage of indexes and use inefficient storage (e.g. in this case, plain text files), both of which would likely improve query performance considerably.
- vicaya 17y agoMR tools, especially high level wrappers like cascading (which gives you capability to do easy joins on Hadoop) are very good for building indices for query. You can use these tools to process the (log) data once and load the results into a scalable db like Hypertable (or even MySQL if the results set is small) and query them.