4 ms·
Here is a quick example of how ChatGPT is getting dumber: Back when they released it, people literally asked the 3.5 version to simulate a terminal and then run
by tomohelix 3y ago
Here is a quick example of how ChatGPT is getting dumber: Back when they released it, people literally asked the 3.5 version to simulate a terminal and then run all kinds of commands on it and even kind of surfing the "web" simulated by the AI and arrived at some hallucinated OpenAI "source code". That was the power of the old version.
Now you need GPT4 to do code interpretation and even then it would not be able to do that kind of experiment anymore.
The kicker? All of this is likely intentional. A pure, full power, unfiltered and unrestricted LLM on the scale of GPT4 would likely be much more powerful and can easily fool people into thinking it is a real AGI. We saw glimpses of this when Microsoft released BingAI and did not put enough guardrails on it. Even restricted to be a search engine, Bing was simulating emotions and had creative uses of its search capabilities, like looking up the person it is talking to and established an opinion of their relationship.
The ChatGPT we are using is lobotomized. But the AI industry isn't. Under the table I am sure there have been pushes into new applications and innovations. The thing is, there is no reason for OpenAI to try harder. Even with the dumbed down ChatGPT, they still have the best AI on the market and everything else is nowhere close. We need more competition either from open source or elsewhere to see the AI getting "smart" again.
- nextaccountic 3y agoThe trouble is that dumber AIs are cheaper to run. As long as people don't have a real alternative, this improves OpenAI's bottom line
- TradingPlaces 3y agoNot even about improving bottom line. The costs of inference at scale are staggering for something like GPT-4. Inference costs rise exponentially with model size. Until everyone stops paying the Nvidia tax, there is no service based on a very large model like GPT-4 that can scale and be profitable. Beyond that, they are constrained by Azure’s GPU infrastructure as well.
- Zetobal 3y agoUm... you know that 3.5 didn't execute code?
- zgluck 3y agoYou read that comment incorrectly, at least as it is right now.
- decremental 3y ago[dead]
- atleastoptimal 3y agoYeah. What benefit does an AI company have to offer dumb normies a SOTA LLM for a reasonable price. What makes the most sense business wise is to offer a quantized dumbed down public model labeled "ChatGPT" on the consumer level and save the real model for enterprise customers or internal use.
- dvngnt_ 3y agoclaude 2 is pretty useful since it has a much higher context window so you can upload entire documents
- TheCaptain4815 3y agoI'm in the Google SGE beta, which is their version of the Bing + GPT4. Thing is, most searches don't require AGI or anywhere near that level of sophistication so the doom n gloom about Google might have been overblown.
- jacobsimon 3y agoI don’t think they changed anything drastic. I’m still able to do the terminal simulation prompt and pretty much anything else from before. I think they improved the guardrails around the responses so you have to try a bit harder, but I wouldn’t say it’s worse.
- cyanydeez 3y agoI'm guessing, with the right objective tests, one could show exponential decline in the answers the more guardrails they clamp in place. Having played with StableDiffision, you can see declines in output using negative prompts, particularly ones using negative inversions. Basically, those guardrails will cut down the realm of valid answers. Think of all the text on the internet that has typos but otherwise are perfectly valid data. You clamp down on the correct spelling and maybe 30% of vector space is just Missing.
- armchairhacker 3y agoHas anyone actually made and used one of those tests to show GPT getting worse “in the wild”? (According to OpenAI’s own GPT4 experiments, guardrails make the AI dumber. But nobody seems to have a concrete question showing the GPT newer version responding worse than GPT older. There were a few candidates in an OpenAI forum but those turned out to just be “model makes the dumb choice X% of the time” and others got the correct output in the newer version.)
- caesil 3y agoAll the OpenAI devrel types on Twitter say it hasn't been meaningfully lobotomized. Based on past Gell-Mann amnesia, especially on this site, claims of "corporate leadership is telling baldfaced lies!" are likely to be false. And finally, this is a product that spits out randomized answers, and we have gotten over our initial wave of euphoria and settled into hedonic adaptation, so we are likely to be less tolerant of failure. I don't want to say you're wrong. But these are reasons to doubt. There are very strong cognitive biases pushing us toward the conclusion that it's gotten dumber, whether it has or not.
- wouldbecouldbe 3y agoThe reason is usage. At this point I will cancel my subscription. And I'm sure more will follow.
- deleted 3y ago[deleted]
- cyanydeez 3y agoMeh, that lobotomy is indictive of the very real limited scope these raw models have to everyday use. If they're actively working on a project it's probably heavily niche and a risky bet.
- guluarte 3y agoAlso the model has been quantized and the number of completion choices reduced.