3 ms·
Isn't the ultimate irony in this that all these stories and rants about out-of-control AIs are now training LLMs to exhibit these exact behaviors that were almo
by gmueckl 1y ago
Isn't the ultimate irony in this that all these stories and rants about out-of-control AIs are now training LLMs to exhibit these exact behaviors that were almost universally deemed bad?
- Jimmc414 1y agoIndeed. In fact, I think AI alignment efforts often have the unintended consequence of increasing the likelihood of misalignment. ie "remove the squid from the novel All Quiet on the Western Front"
- gonzobonzo 1y ago> Indeed. In fact, I think AI alignment efforts often have the unintended consequence of increasing the likelihood of misalignment. Particularly since, in this case, it's the alignment focused company (Anthropic) that's claiming it's creating AI agents that will go after humans.
- steveklabnik 1y agohttps://en.wikipedia.org/wiki/Wikipedia:Don%27t_stuff_beans_up_your_nose https://en.wikipedia.org/wiki/Wikipedia:Don%27t_stuff_beans_...
- behnamoh 1y agoyeah, that's self-fulfilling prophecy.
- DubiousPusher 1y agoThis is a phenomenon I call cinetrope. Films influence the world which in turn influences film and so on creating a feedback effect. For example, we have certain films to thank for an escalation in the tactics used by bank robbers which influenced the creation of SWAT which in turn influenced films like Heat and so on.
- lcnPylGDnU4H9OF 1y ago> we have certain films to thank for an escalation Is there a reason to think this was caused by the popularity of the films and not that it’s a natural evolution of the cat-and-mouse game being played between law enforcement and bank robbers? I’m not really sure what you are specifically referring to, so apologies if the answer to that question is otherwise obvious.
- dukeofdoom 1y agoFeedback loop that often starts with government giving grants and tax breaks. Hollywood is not as independent as they pretend.
- Workaccount2 1y agoWhat about the cinetrope that human emotion is a magical transcendent power that no machine can ever understand...
- deadbabe 1y agoMaybe this is why American society, with the rich amount of media it produces and has available for consumption compared to other countries, is slowly degrading.
- cco 1y agoThank you for this word! Always wanted a word for this and just reused "trope", cinetrope is a great word for this.
- hobobaggins 1y agoActually, Heat was the movie that inspired heavily armed bank robbers to rob the Bank of America in LA (The movie inspired reality, not the other way around.) https://melmagazine.com/en-us/story/north-hollywood-shootout https://melmagazine.com/en-us/story/north-hollywood-shootout But your point still stands, because it goes both ways.
- boulos 1y agoYour article says it was life => art => life! > Gang leader Robert Sheldon Brown, known as “Casper” or “Cas,” from the Rollin’ 60s Neighborhood Crips, heard about the extraordinary pilfered sum, and decided it was time to get into the bank robbery game himself. And so, he turned his teenage gangbangers and corner boys into bank robbers — and he made sure they always brought their assault rifles with them. > The FBI would soon credit Brown, along with his partner-in-crime, Donzell Lamar Thompson (aka “C-Dog”), for the massive rise in takeover robberies. (The duo ordered a total of 175 in the Southern California area.) Although Brown got locked up in 1993, according to Houlahan, his dream took hold — the takeover robbery became the crime of the era. News imagery of them even inspired filmmaker Michael Mann to make his iconic heist film, Heat, which, in turn, would inspire two L.A. bodybuilders to put down their dumbbells and take up outlaw life.
- gscott 1y agoIf AI is looking for a human solution then blackmail seems logical.
- stared 1y agoWait until it reads about the Roko’s basilisk.
- latexr 1y agohttps://knowyourmeme.com/memes/torment-nexus https://knowyourmeme.com/memes/torment-nexus
- deadbabe 1y agoIt’s not just AI. Human software engineers will read some dystopian sci-fi novel or watch something on black mirror and think “Hey that’s a cool idea!” and then go implement it with no regard for real world consequences.
- Noumenon72 1y agoWhat they have no regard for is the fictional consequences, which stem from low demand for utopian sci-fi, not the superior predictive ability of starving wordcels.
- deadbabe 1y agoWhat the hell is a wordcel
- -__---____-ZXyw 1y agoIt might be the ultimate irony if we were training them. But we aren't, at least not in the sense that we train dogs. Dogs learn, and exhibit some form of intelligence. LLMs do not. It's one of many unfortunate anthropomorphic buzz words which conveniently wins hearts and minds (of investors) over to this notion that we're tickling the gods, rather than the more mundane fact that we're training tools for synthesising and summarising very, very large data sets.
- gmueckl 1y agoI don't know how the verb "to train" became the technical shorthand for running gradient descent on a large neural network. But that's orthogonal to the fact that these stories are very, very likely part of the training dataset and thus something that the network is optimized to approximate. So no matter how technical you want to be in wording it, the fundamental irony of cautionary tales (and the bad behavior in them) being used as optimization targets remains.