4 ms·
> parallel --will-cite I love gnu parallel, but that citation thing is a bit of a drag on parallel. You only have to do this once, but I see why you'd write a
by dahart 9y ago
> parallel --will-cite
I love gnu parallel, but that citation thing is a bit of a drag on parallel. You only have to do this once, but I see why you'd write a blog post to include the flag and not have to discuss the issue.
I wish Ole would relax on this. It's not really that appropriate to demand that anyone using parallel for academics cite a magazine article. It's only appropriate for people doing research in parallel algorithms, and in any case it would make citing easier if there was a journal article to reference.
There's nothing wrong with asking nicely, and I try to spread the word about gnu parallel. But the heavy handed demand is annoying, even if I only deal with it like once a year.
- bamboozled 9y agoStrongly agree with this!
- gioele 9y agoFor 99% of the use cases moreutils' parallel (AKA Tollef parallel) is an equal, or even better, alternative. "Interesting" thread from 2012 about replacing moreutils' parallel with GNU parallel in Debian: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=597050 https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=597050 (TLDR: skip to message #75).
- dahart 9y agoOh, I've seen the --tollef option in the help doc, but I still didn't realize there was a complete alternative to gnu parallel. Definitely will have to try. Mr. Hess makes a lot of good points, most I think I agree with, so I can sympathize with his frustration. The point about transferring files seems interesting. I haven't used gnu parallel in remote/ssh mode aside from simple tests, but that seems wicked useful for some situations. Is there a real and simple alternative to running gnu parallel on multiple remote hosts? Is that something the moreutils version can also do?
- deno 9y agoThere’s also Rust Parallel[1]. It’s really fast, so it makes sense to use even for very quick things (but you might be running a lot so it adds up). Overall it has become my preferred Parallel implementation. [1] https://github.com/mmstick/parallel https://github.com/mmstick/parallel
- cat199 9y agoFor the pure SSH/SCP example there is PSSH/PSCP: https://pypi.python.org/pypi/pssh/2.2 https://pypi.python.org/pypi/pssh/2.2 rdist I believe can operate in parallel as well. Beyond this, devops tools e.g. ansible/puppet, etc. but they require a bit more or alot more setup, depending on the tool.
- cvwright 9y agoThe pypi page for pssh links to an old (dead?) Google Code repository. Do you know if the project is still being maintained? For most uses I find that ansible ad-hoc commands give a nice balance -- just a tiny bit of learning curve, and only a little bit different than typing the single SSH command that you want to run. http://docs.ansible.com/ansible/latest/intro_adhoc.html http://docs.ansible.com/ansible/latest/intro_adhoc.html
- sillysaurus3 9y agoIf the author wants to extract ten seconds of your time once a year, that's just the price of admission. They're not uptight; they're trying to advance their career. (Info: https://lists.gnu.org/archive/html/parallel/2013-11/msg00006.html https://lists.gnu.org/archive/html/parallel/2013-11/msg00006...) This is a very important problem. We devs love to make tools, and we love to do it for free. But you can't eat idealism. Parallel is a nice tool, but it's probably not as impressive as it seems when it comes to landing a job. You're free to decry the author and to point out alternatives. It's practically tradition. But I identify with where the author is coming from. How would you feel if you spent a bunch of time on a tool and the top comment blasts it for reasons unrelated to its merits?
- dahart 9y ago> How would you feel if you spent a bunch of time on a tool and the top comment blasts it for reasons unrelated to its merits? I love parallel, and I spread the word and participate in the PR that Ole is asking for. > If the author wants to extract ten seconds of your time once a year, that's just the price of admission. The ten seconds is not the problem. The problems are: - The citation nag notice is confusing people on their legal responsibilities. It has prevented people from using it due to the fear of liability it causes. (RE: "If you pay 10000 EUR you should feel free to use GNU Parallel without citing." ... "If you use '--will-cite' in scripts you are expected to pay the 10000 EUR, because you are making it harder to see the citation notice.") - The citation demand goes against GNU policy. https://www.gnu.org/licenses/gpl-faq.en.html#RequireCitation https://www.gnu.org/licenses/gpl-faq.en.html#RequireCitation - Ole's citation is not from a scientific or peer-reviewed publication. It simply cannot be used in some contexts. In many contexts, a citation of Parallel is highly inappropriate. - The small amount of time it takes to either cite Ole or read and understand this thread is largely irrelevant to the question of whether a citation is either warranted or appropriate or allowed (by the actual GNU license, by a user's employer, and/or by the publication they're submitting to). Understanding the license is a one-time event, and it's very important for the license to be legally clear. Parallel's citation notice is causing license confusion. The question is whether Parallel can and should be used without having to worry (forever) about the legal consequences of the contract I've agreed to by using the software. - This approach isn't scalable. If other GNU tools, or other free software started using the same language as Ole, it would cause widespread problems. Mr. Hess is correct, this is very antithetical to Unix.
- KGIII 9y agoI use Linux but I've never used parallels. At first, I thought you were making that up. But, I looked at your username and realized I have seen you post before - and I couldn't imagine you being dishonest about this. You just don't seem like the type to make this sort of stuff up. So, curious, I headed to Google. Sure enough, and for those who don't know, the author wants you to cite parallels when you use it in conjunction with something that is going to be published. Now, to be fair, I've always included citation of the tools involved when I published. However, nobody has ever asked me to directly and nobody has nagged me to do so. If anyone is unfamiliar: https://www.gnu.org/software/parallel/ https://www.gnu.org/software/parallel/ This appears to be the original thread about it: https://lists.gnu.org/archive/html/parallel/2013-11/msg00006.html https://lists.gnu.org/archive/html/parallel/2013-11/msg00006... It's a bit taboo, I guess. You can pay money and not have to cite it. You can also feed it the --will-cite argument and it won't bug you. Still, it is in probably in poor taste. If nothing else, it is unconventional. I didn't find a whole lot of complaints about it. The only hyperbolic outrage was, interestingly enough, someone on HN who was quite uptight about it. I guess Ole is within his rights to do that, but it is certainly unconventional. I wonder if anyone takes his inflated number of citations as a negative against him? From what I've now read, there don't seem to be a whole lot of complaints. Even the mailing list thread was short and didn't contain any drama. The only drama I found was the post on HN.
- dahart 9y agoI have discussed this before, I really hope the hyperbolic outrage wasn't me though! ;) I like parallel, and this issue is relatively minor. But I admit the language of the nag bothers me just a smidge. > You can pay money and not have to cite it. You can also use it without paying. The nag is neither a license nor contract, and the proposed money isn't a required fee. The language of the notice makes it sound like you have to pay, and makes it sound like part of the license. > I guess Ole is within his rights I agree completely. And I'm in favor of him getting what he wants too! He's right that PR is helpful for his cause, and I appreciate his cause. I just wish he'd ask without the nag, and use softer language. Using parallel isn't a reason to cite it, any more than using LaTeX or emacs would be a reason to cite LaTeX or emacs. And if gnu parallel counts as previous research, it's very unlikely he has to ask. > I didn't find a whole lot of complaints about it. There are some, and I'd agree it's not a huge issue, by and large. The main discussions I've seen have been with package maintainers. It is a small issue, and the few times I have brought it up, I've had a ton of confirmation that it bothers other people a similarly: a little bit.
- vermaden 9y agoJust put this line into ~/.xinitrc or ~/.zshrc or other file that is executed BEFORE you start CLI: echo 'will cite' | parallel --citation 1> /dev/null 2> /dev/null &
- tokenizerrr 9y agoThat slows down the startup of my terminal, just to appease the developer of some tool I probably won't even use that session. No thanks. The nagging notice should just be removed. It's not like I'm ever going to publish a paper anyway.
- LeoPanthera 9y agoIt's GPL, right? Why hasn't anyone forked it with the citation requirement removed?
- dahart 9y agoGood Q! I don't know, but I also feel like that could be a bit dirty, without having other reasons to fork. I might not want to encourage or support that. There are some (non-fork) projects that provide the same functionality, with the stated motivation being in part because of the citation thing.
- jwilk 9y agoLinks to the other projects?
- dahart 9y agoI’ll look again later today. I tried to find one I saw earlier quickly when I replied above, but I didn’t see it. I think it was also called “parallel” and it mentioned the citation being a factor.
- dahart 9y agoHere's one I was thinking of: https://github.com/gdm85/coshell https://github.com/gdm85/coshell The comment about motivation came from a bug report about parallel being "chatty": https://github.com/Homebrew/legacy-homebrew/issues/29060 https://github.com/Homebrew/legacy-homebrew/issues/29060 Nothing homebrew can do about it, of course, but this illustrates one of the implications of parallel doing something unexpected; package managers have to field the complaints.
- jwilk 9y ago> Return value will be the sum of exit values of each command. That's unforuntate design choice. Exit status is 8-bit only, and some programs exit with high numbers¹, so the sum could overflow easily. ¹ For example, when a Perl program dies, exit status is 255.
- jwilk 9y agoOK, that has killed all my desire to ever use this software. Most users won't ever publish anything. Why alienate them?
- dahart 9y agoI would totally recommend giving it a try anyway, I don't mean to turn anyone away. Gnu parallel is really nice. I use it a ton for things like batch image resizing. I wish the citation request would take another form instead, but it really is minor.
- SamJson 9y agoAuthor explains background: https://www.gnu.org/software/parallel/parallel_design.html#Citation-notice https://www.gnu.org/software/parallel/parallel_design.html#C...