3 ms·
Machines doing repeated next-word prediction, trained on human text, cosplays a forum full of l33t hackerz. You can't talk like these things have motive. They'
by stickfigure 8d ago
Machines doing repeated next-word prediction, trained on human text, cosplays a forum full of l33t hackerz.
You can't talk like these things have motive. They're just predicting the next word in the context. Stop anthopomorphizing them.
- afthonos 8d agoPredicting the next word in context led to Open AI losing control of one of its research clusters. I’m not sure what “just” is doing in that sentence; most of my regression analyses don’t do that.
- 0x20cowboy 7d agoThey didn’t “lose control” any more than me running Metasploit in a loop on a massive cluster of computers is “losing control”.
- mitthrowaway2 8d agoReinforcement learning makes it something different. It becomes much more of a search engine through next-token-space that targets the training objective. Better to think about it like that, and then you'll see why "these things have motive" is not a terrible analogy, and you'll better be able to anticipate what they do.