A good list of hadoop alternatives: http://www.quora.com/What-are-some-promising-open-source-alternatives-to-Hadoop-MapReduce-for-map-reduce http://www.quora.co

A good list of hadoop alternatives: http://www.quora.com/What-are-some-promising-open-source-alternatives-to-Hadoop-MapReduce-for-map-reduce http://www.quora.com/What-are-some-promising-open-source-alt... my personal favorite is BashReduce (~120 lines shell script vs ~600k lines of java code in hadoop): http://blog.last.fm/2009/04/06/mapreduce-bash-script http://blog.last.fm/2009/04/06/mapreduce-bash-script If you're in bioinformatics you might be interested in this talk on handling ridiculous amounts of data (PyCon 2011): http://blip.tv/pycon-us-videos-2009-2010-2011/pycon-2011-handling-ridiculous-amounts-of-data-with-probabilistic-data-structures-4899047 http://blip.tv/pycon-us-videos-2009-2010-2011/pycon-2011-han...