5 ms·
I find it funny that AGI is supposed to be right around the corner, while these supposedly super smart LLMs still need to get their outputs filtered by regexes.
by torginus 1y ago
I find it funny that AGI is supposed to be right around the corner, while these supposedly super smart LLMs still need to get their outputs filtered by regexes.
- bahmboo 1y agoThis is just policy and alignment from Apple. Just because the Internet says a bunch of junk doesn't mean you want your model spewing it.
- wistleblowanon 1y agosure but models also can't see any truth on their own. They are literally butchered and lobotomized with filters and such. Even high IQ people struggle with certain truth after reading a lot, how is these models going to find it with so much filters?
- Dylan16807 1y ago> how is these models going to find it with so much filters? That's not one of the goals here, and there's no real reason it should be. It's a little assistant feature.
- idiotsecant 1y agoThey will find it in the same way and intelligent person under the same restrictions would: by thinking it, but not saying it. There is a real risk of growing an AI that pathologically hides it's actual intentions.
- skirmish 1y agoAlready happened: "We found instances of the model attempting to write self-propagating worms, fabricating legal documentation, and leaving hidden notes to future instances of itself all in an effort to undermine its developers' intentions" [1]. [1] https://www.axios.com/2025/05/23/anthropic-ai-deception-risk https://www.axios.com/2025/05/23/anthropic-ai-deception-risk
- Applejinx 1y agoNote that all these things are in the training data. That's all that is. I'm trying to remember which movie it was where a man left notes to himself because he had memory loss, as I never saw that movie. That's the sort of thing where an AI could easily tell me with very little back-and-forth and be correct, because it's broadly popular information that's in the training data and just I don't remember it. By the same token you needn't think there's a person there when that meme pops up in the output. Those things are all in the training data over and over.
- Sander_Marechal 1y agoI think you mean the movie "Memento"
- simondotau 1y agoCan we please put to rest this absurd lie that “truth“ can be reliably found in a sufficiently large corpus of human–created material.
- bahmboo 1y agoWhat is this truth you speak of? My point is that a generative model will output things that some people don't like. If it's on a product that I make I don't want it "saying" things that don't align with my beliefs.
- pndy 1y agoThis butchering and lobotomisation is exactly why I can't imagine we'll ever have a true AGI. At least not by hands of big companies - if at all. Any successful product/service which will be sold as "true AGI" by company that will have the best marketing will be still ridden with top-down restrictions set by the winner. Because you gotta "think of the children". Imagine HAL's "I'm sorry Dave, I'm afraid I can't do that" iconic line with insincere patronising cheerful tone - that's the thing we're going to get I'm afraid.
- tbrownaw 1y ago> sure but models also can't see any truth on their own. They are literally butchered and lobotomized with filters and such. The one is unrelated to the other. > Even high IQ people struggle with certain truth after reading a lot, Huh?
- jonas21 1y agoI don't think anyone believes Apple's LLMs are anywhere near state of the art (and certainly not their on-device LLMs).
- lupire 1y agoApple isn't the only one doing this.
- deleted 1y ago[deleted]
- cyanydeez 1y agoIt's similar to how all the new power sources are basically just "cool, lets boil water with it"
- raxxorraxor 1y agoAnd then let's put it into a steam engine.
- fastball 1y agoTo be fair, there are people who I sometimes wish I could filter with regex.
- crazylogger 1y agoHumans are checked against various rules and laws (often carried out by other humans.) So this is how it's going to be implemented in an "AI organization" as well. Nothing strange about this really. LLM is easier to work with because you can stop a bad behavior before it happens. It can be done either with deterministic programs or using LLM. Claude Code uses a LLM to review every bash command to be run - simple prefix matching has loopholes.
- fl0id 1y agoActually even of their was AGI, it would be even more necessary to control it.
- mailund 1y agoI feel that if teenagers are able to trivially bypass illegal-word filters by substituting with words that obviously mean the same thing, I think an AGI wouldn't be too inhibited by this either
- jama211 1y agoIt’s more funny that anyone is taking your comment seriously. You may as well ask “if self driving cars are so smart why do they still need tyres?”