4 ms·
Sharding a simple bash script across multiple nodes is one of the original (and still one of the most common) uses of Pachyderm. We actually have a tutorial ba
by msteffen 8y ago
Sharding a simple bash script across multiple nodes is one of the original (and still one of the most common) uses of Pachyderm.
We actually have a tutorial based on it: https://github.com/pachyderm/pachyderm/blob/master/doc/examples/fruit_stand/README.md https://github.com/pachyderm/pachyderm/blob/master/doc/examp...
(disclosure: I work at Pachyderm. https://pachyderm.io/ https://pachyderm.io/)
- hinkley 8y agoOr the bland and boring version: bucket sort and xargs.