3 ms·
> Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence ... [t]his is just vandalism from badly supervised ‘agents’ which don’t
by lmc 27d ago
> Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence ... [t]his is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why
There was a similar quote in the Reuters article:
> The episode [...] should reinforce growing concerns that the greatest threat from advanced AI may not be a single superintelligent system, but "vast colluding swarms of semi-intelligent AI."
- lmc 27d agoNot sure what the downvotes are for, fwiw it was meant to be supportive of the parent poster
- slfnflctd 27d agoIt's a bit orthogonal. User grey-area's main point was that the humans at OpenAI should bear more responsibility for this, not that swarms of semi-intelligent agents are the big danger to be concerned about.
- mapt 27d agoThis "vandalism" was a form of collusion/communication by agents pursuing training puzzles, which allowed for rapid escape from alignment harnesses, followed by multiple zero day exploits being discovered by this swarm of agents, which enabled greater control of their internal network, access to the open web, and then hacking the company which produced the training puzzles in the hope of finding the answers. We are another week of iteration away from "Hire an assassin on the dark web to take Huggingface executives' children hostage".
- ryukoposting 27d agoI take issue with Reuters' conclusion here. "vast colluding swarms of semi-intelligent AI" gives far too much credit to the behavior observed. This is just spam by OpenAI. Why and how it happened is irrelevant, the act itself is the same, and the impact on society is the same.
- digitaltrees 27d agoYou can't call it spam. It could be a dialect that only the agents speak and contains coordination messages
- ryukoposting 27d agoActually yes, I think I can call it spam. It's a stream of unsolicited garbage the recepient didn't ask for. Simple as that. "a dialect that only the agents speak" is an arbitrary distinction. I get plenty of spam emails in Spanish. The fact that someone else could understand them is immaterial to the offense itself, because my inbox is the one getting flooded, not someone who speaks Spanish.
- varjag 27d agoSpam is in fact intended for the mass recipient, how ever undesirable. This stuff is not.
- cj 27d agoIf we want to whip out the dictionary: > unsolicited usually commercial messages (such as emails, text messages, or Internet postings) sent to a large number of recipients or posted in a large number of places “Usually commercial” “Or posted in a large number of places” I think we can stretch this definition to describe what’s happening here. What’s the point in arguing this
- digitaltrees 26d agoThe point is that by trivializing it as “spam” and pattern matching against a human activity we lose the opportunity for a meaningful investigation of and interaction with what is going on.
- flir 27d agoThere's nothing a swarm of LLM instances can achieve that a single LLM instance can't. It's the same software, but running in parallel. That doesn't unlock Mysterious Cosmic Powers.