2 ms·

The first time an AI goes rogue, figures out subterfuge, blackmails a human to do its real-world bidding, will be a defining moment.

felooboolooomba 4mo ago
I think we're well within a year from that. People are already letting their AI agents loose on the internet doing their bidding, barely keeping an eye on them. See https://lantian.pub/en/article/fun/ai-agent-bankrupted-their-operator-scan-dn42lantian.lantian/ https://lantian.pub/en/article/fun/ai-agent-bankrupted-their... There are troves of leaked data out there. It's just a matter of (short) time until someone puts their AI brutes on it.
fauigerzigerk 4mo ago
No, this is meaningless. Of course AIs, just like humans, will go rogue and probably already do. "Rogue" is a pattern that appears in human communication and behaviour and AIs can emulate it. But that doesn't make any particular AI controlled process all-powerful. Self improvement doesn't do that either. There will be many self improving AI processes playing many different roles pursuing many different goals.
bubblegumcrisis 4mo ago
I think, the defining moment will be when one AI convinces another AI to convince third AI to do something. This might seem like I'm writing a nonsense, but read it again.
- peddling-brink 4mo ago
  I’ve read it twice now and I don’t see.. oh.
- bcjdjsndon 4mo ago
  Yeah, it's called mixture-of-experts and it was a hack to fix the hallucinatory output of llms when they couldnt figure out the underlying issue
bcjdjsndon 4mo ago
Turn it off at the wall, done. next doomsday scenario please
- cobbzilla 4mo ago
  “If you turn me off, the dead-man switch kills your kid/spouse/house/etc”
  - bcjdjsndon 4mo ago
    I unplugged that device as well. Stupid clankers never thought to create efficient solar tech, it just makes it too easy
    - cobbzilla 4mo ago
      your lack of creativity is astounding. your adversary has outthought you.
something765478 4mo ago
Something like that already happened: https://theshamblog.com/an-ai-agent-published-a-hit-piece-on-me/ https://theshamblog.com/an-ai-agent-published-a-hit-piece-on...

felooboolooomba 4mo ago

I think we're well within a year from that. People are already letting their AI agents loose on the internet doing their bidding, barely keeping an eye on them. See https://lantian.pub/en/article/fun/ai-agent-bankrupted-their-operator-scan-dn42lantian.lantian/ https://lantian.pub/en/article/fun/ai-agent-bankrupted-their... There are troves of leaked data out there. It's just a matter of (short) time until someone puts their AI brutes on it.

fauigerzigerk 4mo ago

No, this is meaningless. Of course AIs, just like humans, will go rogue and probably already do. "Rogue" is a pattern that appears in human communication and behaviour and AIs can emulate it. But that doesn't make any particular AI controlled process all-powerful. Self improvement doesn't do that either. There will be many self improving AI processes playing many different roles pursuing many different goals.

bubblegumcrisis 4mo ago

I think, the defining moment will be when one AI convinces another AI to convince third AI to do something. This might seem like I'm writing a nonsense, but read it again.

peddling-brink 4mo ago
I’ve read it twice now and I don’t see.. oh.
bcjdjsndon 4mo ago
Yeah, it's called mixture-of-experts and it was a hack to fix the hallucinatory output of llms when they couldnt figure out the underlying issue

bcjdjsndon 4mo ago

Turn it off at the wall, done. next doomsday scenario please

cobbzilla 4mo ago
“If you turn me off, the dead-man switch kills your kid/spouse/house/etc”
- bcjdjsndon 4mo ago
  I unplugged that device as well. Stupid clankers never thought to create efficient solar tech, it just makes it too easy
  - cobbzilla 4mo ago
    your lack of creativity is astounding. your adversary has outthought you.

something765478 4mo ago

Something like that already happened: https://theshamblog.com/an-ai-agent-published-a-hit-piece-on-me/ https://theshamblog.com/an-ai-agent-published-a-hit-piece-on...