5 ms·
Luigi does decent job. It is relatively easy to start with and powerful enough to do almost anything
by hamilyon2 11y ago
Luigi does decent job. It is relatively easy to start with and powerful enough to do almost anything
- rch 11y agoI've been using Luigi for a few months, with no complaints. It supports running Python jobs on Hadoop and Spark, but it's not really a MapReduce framework unto itself. However http://discoproject.org/ http://discoproject.org/ might be worth a look as a standalone alternative.
- sitkack 11y agoI have used Disco extensively in the past, nothing but good things to say about it. Fast job launch, easy to write, the DFS has been stellar. This was only using Python for job code.