3 ms·
Looks cool, how's the performance in Go compared to other tools like Python or Ruby streaming?
by HilaPeleg 12y ago
Looks cool, how's the performance in Go compared to other tools like Python or Ruby streaming?
- jondot 12y agoI'm getting great performance out of Go. This is the main reason from moving off my previous JRuby toolkit (also open-source) https://github.com/jondot/hog https://github.com/jondot/hog Eventhough streaming is 30% slower, Go's speed makes up for that and gives me up to 6x speed than the JRuby based solution. The Ruby/JRuby solution has its place though, you have tens of thousands of valid ruby gems to use and it makes a very rapid development experience.
- pjmlp 12y agoWhat about compared with Java, a language with a proper native compiler?
- jondot 12y agoUnfortunately the standard Java map/reduce interface will win out because the IPC is more efficient. But then doing ETL that way becomes clumsy and painfully slow. The idea is the use rapid tools to do the same job. Streaming is then one step higher across the happiness factor because you just use Unix pipes to test your solution (and you can keep piping other tools as well as pipe Crunch processors over and over again)