4 ms·

I'm confused with GPT4o. While it's faster than GPT4, the quality is noticeably worse. It often enters into a state where it just repeats what it already said,

I'm confused with GPT4o. While it's faster than GPT4, the quality is noticeably worse. It often enters into a state where it just repeats what it already said, when all I want is a clarification or another opinion on what we were chatting about. A clarification could be a short sentence, a snipped of code, but no, I get the entire answer again, slightly modified. I cancelled Plus for one month, but got back this week, and for some reason I feel that it really isn't worth it anymore. And the teasing with the free tier, which is downgraded really fast, is more of an annoyance than a solution. There are these promises of "memory" and "talking with it", but they are just ads of something that isn't on the market, at least I don't have access to both of these features. Gemini used to be pretty bad, but for some reason it feels like it has improved a lot, focusing more on the task than on trying to be humanly friendly. Claude and Mistral are not able to execute code, which is a dealbreaker for me.

cyberpunk 2y ago
Yeah, I’ve almost entirely stopped reaching for it anymore. At some point it’s so frustrating getting it to output something halfway towards what I need that I’m just better doing it myself. I’ll probably cancel soon.
cruffle_duffle 2y ago
> It often enters into a state where it just repeats what it already said, when all I want is a clarification or another opinion on what we were chatting about. A clarification could be a short sentence, a snipped of code, but no, I get the entire answer again, slightly modified. It is almost impossible to talk it out of being so repetitive. Super annoying especially since it eats into its own context window.
Marsymars 2y ago
> A clarification could be a short sentence, a snipped of code, but no, I get the entire answer again, slightly modified. This tracks, in the sense that this is what you'll get from many real people when you actually want a clarification.
ravagedbanana 2y ago
I anecdotally agree that GPT-4o often feels really bad, but I can't tell how much of this is due to becoming more accustomed to the quality and hallucinations of using ChatGPT. I tend to see Huggingface's LLM (anonymized, elo-based) Leaderboard as the SoT regarding LLM quality, and according to it GPT-4o is markedly better than GPT-4, and contrary to popular sentiment, is on-par with or better than Claude in most ways (except being slightly worse at coding). Not sure what to believe, or if there is some other dimension that Hugginface is not capturing here.
floam 2y ago
My free account has memory. Do most not?

cyberpunk 2y ago

Yeah, I’ve almost entirely stopped reaching for it anymore. At some point it’s so frustrating getting it to output something halfway towards what I need that I’m just better doing it myself. I’ll probably cancel soon.

cruffle_duffle 2y ago

> It often enters into a state where it just repeats what it already said, when all I want is a clarification or another opinion on what we were chatting about. A clarification could be a short sentence, a snipped of code, but no, I get the entire answer again, slightly modified. It is almost impossible to talk it out of being so repetitive. Super annoying especially since it eats into its own context window.

Marsymars 2y ago

> A clarification could be a short sentence, a snipped of code, but no, I get the entire answer again, slightly modified. This tracks, in the sense that this is what you'll get from many real people when you actually want a clarification.

ravagedbanana 2y ago

I anecdotally agree that GPT-4o often feels really bad, but I can't tell how much of this is due to becoming more accustomed to the quality and hallucinations of using ChatGPT. I tend to see Huggingface's LLM (anonymized, elo-based) Leaderboard as the SoT regarding LLM quality, and according to it GPT-4o is markedly better than GPT-4, and contrary to popular sentiment, is on-par with or better than Claude in most ways (except being slightly worse at coding). Not sure what to believe, or if there is some other dimension that Hugginface is not capturing here.

floam 2y ago

My free account has memory. Do most not?