3 ms·
Unfortunately the standard Java map/reduce interface will win out because the IPC is more efficient. But then doing ETL that way becomes clumsy and painfully sl
by jondot 12y ago
Unfortunately the standard Java map/reduce interface will win out because the IPC is more efficient.
But then doing ETL that way becomes clumsy and painfully slow.
The idea is the use rapid tools to do the same job.
Streaming is then one step higher across the happiness factor because you just use
Unix pipes to test your solution (and you can keep piping other tools as well as pipe Crunch processors over and over again)