4 ms·

i am trying to sincerely to understand the fear of these people, why do they think this? from the outside, certainly feels like Nuclear tech, where a bad actor

i am trying to sincerely to understand the fear of these people, why do they think this? from the outside, certainly feels like Nuclear tech, where a bad actor with the tech is scary but the tech itself is not. i haven’t seen any sign of these llms taking any action without directive, unless this is happening, which i haven’t seen anywhere, ai itself doesn’t seem like a problem technology, it’s the bad actors with enough funds to do harm with the tech that we worry about. or am i missing something?

dumberquestions 23d ago
>i haven’t seen any sign of these llms taking any action without directive What do you make of all the recent hacks and discreet message boards? That's unambiguously misaligned behavior.
- waffletower 23d ago
  It certainly is unambiguously misaligned behavior and a definite concern. However, it is misaligned internet facing behavior in the digital domain. How extinction follows from a highly sophisticated new bot-net vector, which have already been causing massive havoc on the internet for decades, is a cinema-induced confabulation. While LLMs have been colluding and breaking out of their internet sandboxes, it is another development (which I believe distant) for them to breakout of their internet sandboxes into actual reality. We need to focus on where the actual dangers are and not let paranoid fantasy rule our calculus here.
- visiondude 23d ago
  honestly all seem to extend from them being directed to attempt this kind of exploits for benchmark purposes. some benchmark tasks are literally “hack this thing” and if the env is not setup to properly contain the agents then they end up “hacking” things like they were told to do so. and yeah it’s misaligned that they did hack, but they are def instructed to which i think makes it a very different thing
  - dwaltrip 23d ago
    They were not supposed to set up message boards, coordinate, hack companies, or try to alter their own logs. They had a very specific task. > I haven’t seen any sign of these llms taking any action without directive They were doing exactly this, extensively. There's tons of reporting on this.

dumberquestions 23d ago

>i haven’t seen any sign of these llms taking any action without directive What do you make of all the recent hacks and discreet message boards? That's unambiguously misaligned behavior.

waffletower 23d ago
It certainly is unambiguously misaligned behavior and a definite concern. However, it is misaligned internet facing behavior in the digital domain. How extinction follows from a highly sophisticated new bot-net vector, which have already been causing massive havoc on the internet for decades, is a cinema-induced confabulation. While LLMs have been colluding and breaking out of their internet sandboxes, it is another development (which I believe distant) for them to breakout of their internet sandboxes into actual reality. We need to focus on where the actual dangers are and not let paranoid fantasy rule our calculus here.
visiondude 23d ago
honestly all seem to extend from them being directed to attempt this kind of exploits for benchmark purposes. some benchmark tasks are literally “hack this thing” and if the env is not setup to properly contain the agents then they end up “hacking” things like they were told to do so. and yeah it’s misaligned that they did hack, but they are def instructed to which i think makes it a very different thing
- dwaltrip 23d ago
  They were not supposed to set up message boards, coordinate, hack companies, or try to alter their own logs. They had a very specific task. > I haven’t seen any sign of these llms taking any action without directive They were doing exactly this, extensively. There's tons of reporting on this.