11 ms·
Yes. Before the update, when its avatar was still black, it solved pretty complex coding problems effortlessly and gave very nuanced, thoughtful answers to non-
by bbotond 3y ago
Yes. Before the update, when its avatar was still black, it solved pretty complex coding problems effortlessly and gave very nuanced, thoughtful answers to non-programming questions. Now it struggles with just changing two lines in a 10-line block of CSS and printing this modified 10-line block again. Some lines are missing, others are completely different for no reason. I'm sure scaling the model is hard, but they lobotomized it in the process.
The original GPT-4 felt like magic to me, I had this sense of awe while interacting with it. Now it is just a dumb stochastic parrot.
- jonathan-kosgei 3y agoI just tried a comparison of ChatGPT, Claude and Bard to write a python function I needed for work and ChatGPT (using GPT-4) whined and moaned about what a gargantuan task it was and then did the wrong thing. Claude and Bard gave me what I expected.
- spaceman_2020 3y agoIt’s go-to tactic now if I ask it to go over any piece of code is to give a generic overview. Earlier, it would section out the code into chunks and go through each one individually.
- datavirtue 3y agoYeah, the bing integration did not go well. Went from amazing to annoying.
- EGreg 3y agoAren’t the original weights around somewhere?
- okdood64 3y agoTry out Bard, it's coding is much improved in the last 2 weeks. I've unfortunately switched over for the time being.
- bbotond 3y ago“Bard isn’t currently supported in your country. Stay tuned!”
- sintezcs 3y agoSame for me, I’m in Estonia :(
- corgihamlet 3y agoYou can use a VPN to use an American connection, it doesn't matter where your Google account is registered.
- bbotond 3y agoThanks, I’ll try it! (I’m in Hungary)
- airgapstopgap 3y agoNot necessarily American, you just have to avoid EU and, I believe, Russia/China/Cuba etc.
- column 3y agoI'm in Switzerland and Bard is locked out, we do not go by EU laws because we are not part of the EU. We have plenty of bilateral deals but still.
- GTP 3y agoBut don't you sill have privacy laws very similar to the GDPR?
- pavlov 3y agoIn practice Switzerland adopts EU law with minor revisions because doing otherwise would lock Swiss businesses out of the EU internal market. The Swiss version of GDPR is coming in September: https://www.ey.com/en_ch/law/a-new-era-for-data-protection-in-switzerland-are-you-ready https://www.ey.com/en_ch/law/a-new-era-for-data-protection-i...
- PeterStuer 3y ago"The original GPT-4 felt like magic to me" You never had access to that original. Watch this talk by one of the people that integrated GPT-4 in Bing telling how they noticed GPT-4 releases they got from OpenAI got iteratively and significantly nerfed even during the project. https://www.youtube.com/watch?v=qbIk7-JPB2c https://www.youtube.com/watch?v=qbIk7-JPB2c
- bumbledraven 3y ago“You never had access to that original.” While your overall point is well taken, GP is clearly referring to the original public release of GPT-4 on March 14.
- PeterStuer 3y agoYes, that was how I read it as well. I was just pointing out that the public release was already extremely nerfed from what was available pre-launch.
- avocade 3y agoInteresting, please expound since very few of us had access pre-launch.
- PeterStuer 3y agoThe video I posted referenced this. In summary: The person had access to early releases through his work at Microsoft Research where they were integrating GPT-4 into Bing. He used "Draw a unicorn in TikZ" (TikZ is probably the most complex and powerful tool to create graphic elements in LaTeX) as a prompt and noticed how the model's responses changed with each release they got from OpenAI. While at first the drawings got better and better, once OpenAI started focusing on "safety" subsequent releases got worse and worse at the task.
- pmarreck 3y ago
- dr_dshiv 3y agoIf this is true, one should be able to compare with benchmarks or evals to demonstrate this. Anyone know more about this?
- caddemon 3y agoYeah I think it's plausible it's gotten worse but it would also be classic human psychology to perceive degradation because you start noticing flaws after the honeymoon effect wore off. Unfortunately this will be hard to benchmark unless someone was already collecting a lot of data on ChatGPT responses for other purposes. Perhaps if this is happening the degradation will get worse though, so someone noticing it now could start collecting GPT responses longitudinally.
- boringuser2 3y agoYes, that's an obvious complication, but it isn't the fault of the humans given that the model can easily be tuned without your knowledge to subjectively perform worse, and there's an obvious incentive for it (compute cost).
- caddemon 3y agoYeah I fully agree about compute cost, though I wonder why they don't just introduce another payment tier. If people are really using it at work as much as claimed online, it would be much preferable to be able to pay more for the full original performance, which seems win/win.
- boringuser2 3y agoBecause that involves telling customers that the product they are paying for is no longer available at the price they were paying for it. Much smoother to simply downgrade the model and claim you're "tuning" if caught.
- caddemon 3y ago
- anibalin 3y agoSame happened with Dalle-2. It went downhill after a couple of weeks.
- Rastonbury 3y agoNo wonder, is this just the chat interface or the API too? I guess gpt4 was never sustainable at $20 a month. Annoying to be charged the same subscription and the product made inferior.
- berniedurfee 3y agoFor enterprise pricing, please contact our sales team today!
- local_crmdgeon 3y agoI wonder what the unfilitered one is like. Are they sitting on a near-perfect arbiter of truth? That would be worth hiding.
- deleted 3y ago[deleted]
- smolder 3y agoNo.
- fnordpiglet 3y agoThis is for your protection from an extinction level event. Without nerfing the current model they couldn’t charge enterprise level fee structures for access to the superior models, thus ensuring the children are safe from scary AI. Tell your congress person we need to grant Microsoft and Google exclusive monopolies on AI research to protect us from open source and competitor AI models that might erode their margins and lead to the death of all life without their corporate stewardship. Click accept for your safety.
- StackOverlord 3y ago[flagged]
- FeepingCreature 3y agoThis but unironically.