3 ms·

can't decide what is better? 1) curl | sh 2) llm | sh

mminer237 2y ago
Using curl is surprisingly secure if you have a secure entrusted target. An LLM could be safe the first 99 times and then randomly wipe your hard drive. It's basically the same thing as curl but just randomly picking what you download, like that one thing that picked random code from stack overflow
- lyu07282 2y ago
  > Using curl is surprisingly secure one thing to remember is that you can make a server respond one thing when a user does "curl <url>" and another thing when the users does "curl <url> | sh": https://lukespademan.com/blog/the-dangers-of-curlbash/ https://lukespademan.com/blog/the-dangers-of-curlbash/ another thing to know is that github.com/<org>/<proj>/[...somethings...] isn't necessarily controlled by <org>: https://vulcan.io/blog/github-comment-malware-what-you-need-to-know/ https://vulcan.io/blog/github-comment-malware-what-you-need-...
  - leoh 2y ago
    Yes but you could do something equivalent with a binary you download or some remote repository like a brew keg too. At the end of the day you need to decide whether you trust who you’re downloading from or not and ‘curl … | sh’ isn’t practically worse in any way I can think of.
  - rezonant 2y ago
    Also, if entropy decides you are unworthy and the download dies after reading "rm -Rf /" instead of the full line "rm -Rf /tmp/setup" then you're going to have a bad time on any Linux that doesn't have preserve-root by default. Of course such deleterious incomplete command execution could take many forms.
    - amake 2y ago
      This is trivially prevented by wrapping the body in a function that is executed only on the last line of the script. I don't think I've seen a "curl | sh" script in the wild that wasn't written that way.
- kaibee 2y ago
  > An LLM could be safe the first 99 times and then randomly wipe your hard drive. So like, has anyone ever actually done enough fuzzing to see if this or other actually bad commands ever happen in practice, or are we just going on vibes here? I suppose its possible that you give it a text description to do something bad and it does, but I'm actually curious if this is just 'llms bad' vibes.
  - internetter 2y ago
    Not intentionally, but its given me incorrect SQL that feels one step away from something incredibly dangerous
amiga386 2y ago
3) curl https://github.com/ojaswa1942/russian-roulette.sh/raw/master/russian_roulette.sh https://github.com/ojaswa1942/russian-roulette.sh/raw/master... | sudo sh -
hawski 2y ago
invoke-undefined-behaviour | sh We live in times where you shouldn't use C or C++, because undefined behavior can eat your face and general memory safety issues, but at the same time let's pipe LLM output to your shell. It is causing a little tingling in my heart.
deleted 2y ago
[deleted]
baq 2y ago
forgot '3) apt-get install -y package; bin-from-package'

Using curl is surprisingly secure if you have a secure entrusted target. An LLM could be safe the first 99 times and then randomly wipe your hard drive. It's basically the same thing as curl but just randomly picking what you download, like that one thing that picked random code from stack overflow

lyu07282 2y ago
> Using curl is surprisingly secure one thing to remember is that you can make a server respond one thing when a user does "curl <url>" and another thing when the users does "curl <url> | sh": https://lukespademan.com/blog/the-dangers-of-curlbash/ https://lukespademan.com/blog/the-dangers-of-curlbash/ another thing to know is that github.com/<org>/<proj>/[...somethings...] isn't necessarily controlled by <org>: https://vulcan.io/blog/github-comment-malware-what-you-need-to-know/ https://vulcan.io/blog/github-comment-malware-what-you-need-...
- leoh 2y ago
  Yes but you could do something equivalent with a binary you download or some remote repository like a brew keg too. At the end of the day you need to decide whether you trust who you’re downloading from or not and ‘curl … | sh’ isn’t practically worse in any way I can think of.
- rezonant 2y ago
  Also, if entropy decides you are unworthy and the download dies after reading "rm -Rf /" instead of the full line "rm -Rf /tmp/setup" then you're going to have a bad time on any Linux that doesn't have preserve-root by default. Of course such deleterious incomplete command execution could take many forms.
  - amake 2y ago
    This is trivially prevented by wrapping the body in a function that is executed only on the last line of the script. I don't think I've seen a "curl | sh" script in the wild that wasn't written that way.
kaibee 2y ago
> An LLM could be safe the first 99 times and then randomly wipe your hard drive. So like, has anyone ever actually done enough fuzzing to see if this or other actually bad commands ever happen in practice, or are we just going on vibes here? I suppose its possible that you give it a text description to do something bad and it does, but I'm actually curious if this is just 'llms bad' vibes.
- internetter 2y ago
  Not intentionally, but its given me incorrect SQL that feels one step away from something incredibly dangerous

amiga386 2y ago

3) curl https://github.com/ojaswa1942/russian-roulette.sh/raw/master/russian_roulette.sh https://github.com/ojaswa1942/russian-roulette.sh/raw/master... | sudo sh -

hawski 2y ago

invoke-undefined-behaviour | sh We live in times where you shouldn't use C or C++, because undefined behavior can eat your face and general memory safety issues, but at the same time let's pipe LLM output to your shell. It is causing a little tingling in my heart.

deleted 2y ago

[deleted]

baq 2y ago

forgot '3) apt-get install -y package; bin-from-package'