3 ms·
Command-line Tools can be 235x Faster than your Hadoop Cluster – Adam Drake
- nanis 5y agoI can't remember which but one of the R books had a paragraph about cutting down run time from a day to a few hours by setting up a Hadoop cluster ... Then the author said, something along the lines of "of course, it would take about 15 minutes using Perl." It's a matter of using the right tool for the job. Too many people are too excited about implementing something "big" instead of getting the bits from over here to over there.
- eesmith 5y ago(2014) and an evergreen HN topic - https://hn.algolia.com/?dateRange=all&page=0&prefix=true&query=Command-line%20Tools%20can%20be%20235x%20Faster%20t&sort=byDate&type=story https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que... .
- 1MachineElf 5y agoJoyent's Manta took this concept to the extreme. Previous discussion here: https://news.ycombinator.com/item?id=5939340 https://news.ycombinator.com/item?id=5939340 Image manipulation example: https://www.joyent.com/blog/joyent-manta-storage-service-image-manipulation-and-publishing-part-2 https://www.joyent.com/blog/joyent-manta-storage-service-ima... Manta repo an GitHub: https://github.com/joyent/manta https://github.com/joyent/manta