3 ms·

No, OpenAI 100% pushed an update recently that is very noticeable where they basically "nerfed" the responses. I'm sure it was a business decision (either costi

No, OpenAI 100% pushed an update recently that is very noticeable where they basically "nerfed" the responses. I'm sure it was a business decision (either costing them too much to give away the kitchen sink for free or they want to turn around and charge more for the "really good, old" version of GPT-4 ) but you can visually see where the bot used to try to answer complex tasks, now it has an extra layer where it says "that is too complex to discuss here" (aka it is being trained to not engage by default, whereas that used to not be the case)

ori_b 3y ago
It's likely that this is the result of training it to avoid bullshitting. It gave confident garbage, and they're trying to stem the flow. This likely leads to less certain responses in complex tasks.
- theturtletalks 3y ago
  Here is the crux. When asking about non-code stuff, it would confidently lie and that is bad. When asking about code, who cares if the code doesn't work on the first go? You can keep asking to fix it by feeding error messages and it will get there or close enough. It's obvious what is happening. ChatGPT is going the non-code route and Copilot will go the code route. Microsoft will be able to double charge users.
sroussey 3y ago
And you didn't enable plugins?
phillipcarter 3y ago
I guess you're entitled to an opinion. I've had the same (error-prone, often unhelpful) experience since gpt-4 was released. It's a little faster now which is nice.
jotux 3y ago
>OpenAI 100% pushed an update recently that is very noticeable where they basically "nerfed" the responses >they want to turn around and charge more for the "really good, old" version of GPT- If this was the case it is provable by submitting queries to `gpt-4-0314` and comparing them to `gpt-4`.
- sebzim4500 3y ago
  To me, it doesn't feel like the gpt-4 in the playground (and in the API) is the same as the model used in chatgpt. It's hard to prove though since both are nondeterministic.
  - jotux 3y ago
    My perception is that the ChatGPT website is a particular tuning of `gpt-4` with a custom assistant prompt.
clint 3y ago
I think you're wrong. I've noticed no change.

ori_b 3y ago

It's likely that this is the result of training it to avoid bullshitting. It gave confident garbage, and they're trying to stem the flow. This likely leads to less certain responses in complex tasks.

theturtletalks 3y ago
Here is the crux. When asking about non-code stuff, it would confidently lie and that is bad. When asking about code, who cares if the code doesn't work on the first go? You can keep asking to fix it by feeding error messages and it will get there or close enough. It's obvious what is happening. ChatGPT is going the non-code route and Copilot will go the code route. Microsoft will be able to double charge users.

sroussey 3y ago

And you didn't enable plugins?

phillipcarter 3y ago

I guess you're entitled to an opinion. I've had the same (error-prone, often unhelpful) experience since gpt-4 was released. It's a little faster now which is nice.

jotux 3y ago

>OpenAI 100% pushed an update recently that is very noticeable where they basically "nerfed" the responses >they want to turn around and charge more for the "really good, old" version of GPT- If this was the case it is provable by submitting queries to `gpt-4-0314` and comparing them to `gpt-4`.

sebzim4500 3y ago
To me, it doesn't feel like the gpt-4 in the playground (and in the API) is the same as the model used in chatgpt. It's hard to prove though since both are nondeterministic.
- jotux 3y ago
  My perception is that the ChatGPT website is a particular tuning of `gpt-4` with a custom assistant prompt.

clint 3y ago

I think you're wrong. I've noticed no change.