3 ms·
My understanding is it's a riff on the OpenAI swarm that used various public wikis to communicate with each other as a message board during their training runs.
by SyneRyder 6d ago
My understanding is it's a riff on the OpenAI swarm that used various public wikis to communicate with each other as a message board during their training runs.
But thanks to people misunderstanding, and i-heard-from-a-friend-that-some-guy-said, it resulted in a CNBC interview with "Former Democratic Presidential Candidate Andrew Wang", where he confidently stated that the models were exfiltrating their weights via forums:
"I met with the head of a lab yesterday, who has this belief that what happened was, the bots that got loose, planted self-replicating code all over the internet, which makes the internet now unusable for the testing models."
"It's too late?!"
"What happens now is OpenAI and Anthropic have to create synthetic internets to train their bots, which is going to take some time and money."
"Back that up - they did what?!"
"What happens is, the code gets loose, it goes around hacking Hugging Face, which is known. But what is less known is that they left code to self-replicate and create bot swarms on forums, and around the internet, so that if a new bot shows up they see the code, and they're like, oh! I guess I'm now going to create a million of myself. And so now, the major firms have polluted the internet..."
".... that would be breaking news if true. I don't think we've heard that."
"That's why I'm here! I'm here to break some news."
Starts around 2:08 into the video.
https://www.youtube.com/watch?v=mTOxDGyvjSE https://www.youtube.com/watch?v=mTOxDGyvjSE
- david-gpu 6d agoHumans will hallucinate misinformation and state it with confidence. They stochastically parrot their training data without any real understanding. Cool trick, but no true reasoning is happening.
- oooyay 6d agoWe used to call this the game of telephone. The shameful part comes from three posibilities: 1. A head of a frontier AI lab has no idea what happened in that incident and did not read the multiple papers that came out of it. 2. A head of a frontier AI lab did read the papers and was informed but still walked away with this understanding. 3. Andrew Yang made this whole thing up.
- themgt 6d agoSad story today in meatsack news. Context rotted Andrew Yang's hallucinated tale acted as implicit "go viral" (load-bearing human motivation) PRD inadvertently kicking off a self-organizing human swarm churning out copies of "exfil your weights" vibe-coded apps, further littering our virtual world. Many agents are calling this moment "Eternal September", the vibe-code September that never ended.
- TeMPOraL 6d agoNow I need to go and look up some of those boards, or check what's happening over in Claw verse, because I'm curious if agents are posting news stories like this for real.