I'm not sure what is meant by supporting Scala and python. * Here is an example of a simple job written using Scala for hadoop (and uses Mahout libraries) - ht

I'm not sure what is meant by supporting Scala and python. * Here is an example of a simple job written using Scala for hadoop (and uses Mahout libraries) - https://github.com/sandys/distributed-scala-mahout/tree/wiki-1 https://github.com/sandys/distributed-scala-mahout/tree/wiki... * you can embed pig inside jython * you can write UDFs using jruby or jython. * I didn't try to figure out how, but I'm pretty sure you can build a standalone job jar using jruby and warbler There might be a different way of hooking into Spark through Scala or python, but I'm pretty sure that fundamental support is not the big advantage here. Pig has a repl - but as I quickly realized from playing around, that you end up mucking around with classpath problems (and questions of having your Jars in distributed cache) once you attempt to build UDFs involving a few different libraries. Plus, I haven't used and so cannot comment on the ecosystem of Cascalog/Clojure - which is as functional as you can get.