7 ms·
Either more tools like this are going to pop up, or the existing ones will mature, as more people adopt Lambda style architectures, I'd imagine. While building
by optimusclimb 11y ago
Either more tools like this are going to pop up, or the existing ones will mature, as more people adopt Lambda style architectures, I'd imagine.
While building one out, we looked at VoldemortDB, SploutSQL, and ElephantDB to serve bulk data coming out of Hadoop in batches. Voldemort turned out to be much rougher around the edges than expected, ElephantDB looked very bleeding edge, and SploutSQL wasn't as general purpose. In the end we turned to Cassandra and this tool - https://github.com/spotify/hdfs2cass https://github.com/spotify/hdfs2cass.
Good to see Pinterest open sourcing this.