3 ms·
Sorry Vosper - just saw this. We started with a Hive-based approach for SnowPlow but got tired of having to run a map-reduce for each query, so started looking
by alexatkeplar 14y ago
Sorry Vosper - just saw this. We started with a Hive-based approach for SnowPlow but got tired of having to run a map-reduce for each query, so started looking at columnar databases. ICE is the first columnar database we have integrated SnowPlow with - mainly picked because the OSS project is quite well documented and supported, rather than because of any performance benchmarks. We will probably integrate with other columnar dbs in due course too (e.g. Vertica, Greenplum). Thanks for the Hypertable steer - will definitely take a look at that too.