3 ms·
Isn't it kind of unfair to compare xargs parallelizing, which as far as I know all happens on the same machine, with cloud-scaled parallelizing through various
by unwind 16y ago
Isn't it kind of unfair to compare xargs parallelizing, which as far as I know all happens on the same machine, with cloud-scaled parallelizing through various services?
Sure, it's awesome to use a ready-made tool to get that kind of scalability, but is it really apples/apples?
- jcromartie 16y agoI don't think it's unfair at all. Add split and ssh to the mix and now you're distributed. "Cloud-scale" just means "more hardware than we own" and seems to me like a step backward in computing, to a time when you paid to time-share a relatively powerful machine. The main appeal of cloud computing is outsourcing the ownership of the machines and responsibilities like configuring, storing, powering, and repairing them. I am not saying there isn't a use for the cloud computing capacity or the benefits it offers... but I just think that the hype can be distilled down to "you don't have to take care of a bunch of servers" for the average business.
- jwhitlark 16y agoWhere I work, we've run into a great deal of pain scripting ssh. For a one off job, I'd agree, but if you want something stable over time, well.... I'm not dissing ssh, I just don't think automatically running jobs on remote machines is its sweet spot.
- caffeine 16y agoCheck out GNU parallel