3 ms·
We've been using the file-oriented, shell-based map-reduce model for a while with Joyent's Manta, and it's been a great fit for a variety of tasks. We've used
by dap 12y ago
We've been using the file-oriented, shell-based map-reduce model for a while with Joyent's Manta, and it's been a great fit for a variety of tasks. We've used it internally for everything from log analysis to video transcoding to Mario Kart analytics[0]. Map-reduce is a great model for distributing work, and the shell is a great model for expressing what that work is.
Disclaimer: I work at Joyent and helped build Manta. :)
[0] http://kartlytics.com http://kartlytics.com