3 ms·

> There isnt going to be a HAL or Terminator style situation ... I don't believe for a second we'll have an evil AI. However I do believe it's very likely we m

> There isnt going to be a HAL or Terminator style situation ... I don't believe for a second we'll have an evil AI. However I do believe it's very likely we may rely on AI slop so much that we'll have countless outages with "nobody knowing how to turn the mediocrity off". The risk ain't "super-intelligent evil AI": the risk is idiots putting even more idiotic things in charge. And I'm no luddite: I use models daily.

esafak 7mo ago
Didn't you read the news about the 'claw that blackmailed an open source maintainer last week? It was autonomous, but it could be turned off. How hard is it to extrapolate from that to an agent that worms its way out of its sandbox?
- tsimionescu 7mo ago
  What makes you think that was an autonomous agent, and not someone playing with AI?
baq 7mo ago
> I don't believe for a second we'll have an evil AI. Doesn’t have to be evil to be disastrous. Misaligned is plenty enough. https://en.wikipedia.org/wiki/Instrumental_convergence https://en.wikipedia.org/wiki/Instrumental_convergence