4 ms·

It's no coincidence the "free" service is visibly crippled, while paid API users are not reporting any difference. GPT-4 is not available to free users, which

It's no coincidence the "free" service is visibly crippled, while paid API users are not reporting any difference. GPT-4 is not available to free users, which really calls the pretext of this comment into question. What is being alleged to have happened, and why is this response unreasonable? I’m not a very heavy GPT-4 user but I do usually use it once a day or so - it doesn’t appear to have changed noticeably but I’m not paying close attention.

shmoogy 3y ago
ChatGPT4 feels (is?) typically faster, and the results feel ... above 3.5 turbo but below what 4 was. The API seems exactly the same to me, but you cant do an apples to apples test due to variance between replies. I dont really doubt they scaled the chatGPT4 model down a little to try to save costs with the plugins and increased usage
- californical 3y ago
  Yeah I’m having the same experience. The replies have gotten faster in the last few days, at the expense of quality. It’s noticeable because I used to be able to read each word as it was printed from the GPt-4 output, but now it goes far too fast for me to keep up with. Kinda sucks to not have transparency at all into the black box, they’ve strayed so far from “open” at this point that it’s comedic
jstarfish 3y ago
It was badly-worded on my part. And I stand corrected-- I just saw all the nested tweets where people are complaining about the API too! So many people are noticing a degradation in speed and quality of responses, and not in isolation. Rather than acknowledge this, the question is rephrased to one the responder can rightfully deny-- and suggest no changes have taken place without explicitly saying as much. You normally only see this sort of sliminess from politicians and executives on the witness stand. > Is anyone else noticing significantly downgraded GPT-4 capabilities today? Seems like OpenAI updated the model, and results aren’t as good as before. [mentions API in a child comment] > The API does not just change without us telling you. The models are static there. > This is good to know. That means GPT-4 has been static since March right? 0314? > Correct Never ask questions to which one word suffices as an answer. Collective confusion in the thread suggests something has changed, but the most OpenAI will attest to is that the API is unchanged and the models are static. And this may well be true, but rather than admit "...but we were fucking with the middleware/parameters" they took a firm position on a strawman argument and ignored everybody who followed with more-direct questions. Except this guy: > I've noticed inconsistency with certain prompts performance. Is that just the non-deterministic nature of the API? > Yes Oh, ok. It's because the fucking API is non-deterministic that code that has worked both reliably and predictably for everyone now runs like shit for everyone. For fuck's sake, you can get better answers from a Magic 8-Ball. This guy even made the mistake of presenting an answer he'd believe for the respondent to feed into. He might as well have asked if inconsistent performance was because of the war in Ukraine. "Logan.GPT" must moonlight as a fortune teller. He's only responding to people foolish enough to ask the wrong questions.
- avereveard 3y ago
  And anyway my program used the api with a temperature of zero and it still started acting erratically. They are not telling it straight.
- TeMPOraL 3y ago
  > Collective confusion in the thread suggests something has changed, but the most OpenAI will attest to is that the API is unchanged and the models are static. And this may well be true Here's the thing. Re-read the exchange you quoted: >> The API does not just change without us telling you. The models are static there. >> This is good to know. That means GPT-4 has been static since March right? 0314? >> Correct Does that "Correct" mean all GPT-4 models have been static since March, or does it only cover the gpt-4-0314, which is a single, specific model? gpt-4-0314 is the static snapshot model, hence 0314 in the name; it exist as a stable base, while gpt-4 was intended to be updated over time. So I feel OpenAI may be dodging here. That "Correct" may just mean "the gpt-4-0314 model was not updated since March 14", which is, like, the very reason this model exists in the first place. Important point: if you're using API pay-as-you-go access, unless you wrote the very tools you use with that API, you're most likely using gpt-4, and not gpt-4-0314.
  - rrrrrrrrrrrryan 3y ago
    > if you're using API pay-as-you-go access, unless you wrote the very tools you use with that API, you're most likely using gpt-4, and not gpt-4-0314. Do you know of any alternative ChatGPT UIs like chatbotui.com or typingmind.com that let you specify the model gpt-4-0314 ? This feature alone would be enough for me to switch.

shmoogy 3y ago

ChatGPT4 feels (is?) typically faster, and the results feel ... above 3.5 turbo but below what 4 was. The API seems exactly the same to me, but you cant do an apples to apples test due to variance between replies. I dont really doubt they scaled the chatGPT4 model down a little to try to save costs with the plugins and increased usage

californical 3y ago
Yeah I’m having the same experience. The replies have gotten faster in the last few days, at the expense of quality. It’s noticeable because I used to be able to read each word as it was printed from the GPt-4 output, but now it goes far too fast for me to keep up with. Kinda sucks to not have transparency at all into the black box, they’ve strayed so far from “open” at this point that it’s comedic

jstarfish 3y ago

It was badly-worded on my part. And I stand corrected-- I just saw all the nested tweets where people are complaining about the API too! So many people are noticing a degradation in speed and quality of responses, and not in isolation. Rather than acknowledge this, the question is rephrased to one the responder can rightfully deny-- and suggest no changes have taken place without explicitly saying as much. You normally only see this sort of sliminess from politicians and executives on the witness stand. > Is anyone else noticing significantly downgraded GPT-4 capabilities today? Seems like OpenAI updated the model, and results aren’t as good as before. [mentions API in a child comment] > The API does not just change without us telling you. The models are static there. > This is good to know. That means GPT-4 has been static since March right? 0314? > Correct Never ask questions to which one word suffices as an answer. Collective confusion in the thread suggests something has changed, but the most OpenAI will attest to is that the API is unchanged and the models are static. And this may well be true, but rather than admit "...but we were fucking with the middleware/parameters" they took a firm position on a strawman argument and ignored everybody who followed with more-direct questions. Except this guy: > I've noticed inconsistency with certain prompts performance. Is that just the non-deterministic nature of the API? > Yes Oh, ok. It's because the fucking API is non-deterministic that code that has worked both reliably and predictably for everyone now runs like shit for everyone. For fuck's sake, you can get better answers from a Magic 8-Ball. This guy even made the mistake of presenting an answer he'd believe for the respondent to feed into. He might as well have asked if inconsistent performance was because of the war in Ukraine. "Logan.GPT" must moonlight as a fortune teller. He's only responding to people foolish enough to ask the wrong questions.

avereveard 3y ago
And anyway my program used the api with a temperature of zero and it still started acting erratically. They are not telling it straight.
TeMPOraL 3y ago
> Collective confusion in the thread suggests something has changed, but the most OpenAI will attest to is that the API is unchanged and the models are static. And this may well be true Here's the thing. Re-read the exchange you quoted: >> The API does not just change without us telling you. The models are static there. >> This is good to know. That means GPT-4 has been static since March right? 0314? >> Correct Does that "Correct" mean all GPT-4 models have been static since March, or does it only cover the gpt-4-0314, which is a single, specific model? gpt-4-0314 is the static snapshot model, hence 0314 in the name; it exist as a stable base, while gpt-4 was intended to be updated over time. So I feel OpenAI may be dodging here. That "Correct" may just mean "the gpt-4-0314 model was not updated since March 14", which is, like, the very reason this model exists in the first place. Important point: if you're using API pay-as-you-go access, unless you wrote the very tools you use with that API, you're most likely using gpt-4, and not gpt-4-0314.
- rrrrrrrrrrrryan 3y ago
  > if you're using API pay-as-you-go access, unless you wrote the very tools you use with that API, you're most likely using gpt-4, and not gpt-4-0314. Do you know of any alternative ChatGPT UIs like chatbotui.com or typingmind.com that let you specify the model gpt-4-0314 ? This feature alone would be enough for me to switch.