7 ms·
ChatGPT 5 is slow and no better than 4
Have general LLMs clearly peaked?
- mikert89 1y agoHave you used the Pro version? Its incredible
- ManlyBread 1y ago>229 EUR a month LOL
- iwontberude 1y ago[flagged]
- labrador 1y agoGPT-5 is better as a conversational thinking partner than GPT-4o. It's answers are more concise, focused and informative. The conversation flows. GPT-5 feels more mature than GPT-4o with less juvenile "glazing." I can't speak to other uses such as coding, but as a sounding board GPT-5 is better than GPT-4o, which was already pretty good. GPT-5's personality has definitely shifted to a more professional tone which I like. I do understand why people are missing the more synchophant persoanlity of GPT-4o, but I'm not one of them.
- saulpw 1y agoThat sounds 10% better, not 10x better. That's close enough to 'peaked'.
- labrador 1y agoAgreed. Sam Altman definitely over-hyped GPT-5. It's not so much more capable that it deserves a major version number bump.
- 3836293648 1y agoSurely a major version bump says more about the internals than the capabilities
- labrador 1y agoI see your point from a software engineering perspective but unfortuately that's not how the public sees it. The common perception is that we are making leaps towards AGI. I never thought AGI was close so I'm not disappointed, but a lot of people seem to be. On the other hand, I've seen comments like "I guess my fears of a destructive super-intelligence were over-blown."
- kjkjadksj 1y agoPeople seem to make this exact comment on here at every gpt release. I wonder what gpt we ought to actually be on? 1.4.6?
- labrador 1y agoIn retrospect I would have named it as follows: GPT-4 -> GPT-4 Home GPT-5 -> GPT-4 Enterprise Because my impression after using GPT-5 that it is designed to satisfy the needs of Microsoft mainly. Microsoft has no interest in making AI therapists or AI companions, probably because of the legal liability. Also, that's outside their core business.
- coldtea 1y ago3.something. They make "this exact comment on here at every gpt release" because every GPT release is touted as revolutionary and it's increasinly a smaller bump.
- BriggyDwiggs42 1y ago4 was definitely way better
- torginus 1y ago
- al_borland 1y agoBy definition, if something is still getting 10% better each year it hasn’t yet peaked. Not even close.
- coldtea 1y agoGetting 10% better over this last year compared to, say, 100% and 50% and 25% better the 4-5 years before? I'd say that points to it being very close to peaked. Nobody said anything about a steady 10% year-over-year being the case forever...
- anuramat 1y agokinda how theoretical physics peaked in 1878, as predicted by Philipp von Jolly? why does everyone feel the urge to extrapolate a vibe-based metric based on three points? isn't scientific/technological progress inherently unpredictable anyway
- coldtea 1y agoNo, more like how theoretical physics peaked in 1960s. >why does everyone feel the urge to extrapolate a vibe-based metric based on three points? Because marketers of AI extrapolate even worse to hype it, and a counter-correction is needed...
- anuramat 1y agoI meant that we could be in the 19th century stage, not that we necessarily are > marketers of AI why would I ever consider their opinion to be valuable?
- BriggyDwiggs42 1y agoIt’s just extrapolating the asymptote man.
- dileeparanawake 1y agoYep right now I’m not even sure I’d say it’s 10% better (at things I use it for). Feels overhyped based on the launch and what every influencer covered in their review (maybe obviously). Maybe it will get better as they sort out routing and other kinks. Right now feels like big gap between marketing and reality.
- binarymax 1y agoMy primary use case for LLMs are running jobs at scale over an API, and not chat. Yes it's very slow, and it is annoying. Getting a response from GPT-5-mini for <Classify these 50 tokens as true or false> takes 5 seconds, compared to GPT-4o which takes about a second.
- jscheel 1y agoDoing quite a bit of that as well, but I’ve held off moving anything to gpt-5 yet. Guessing it’s a capacity issue right now.
- hoppp 1y agoIf its 5 seconds maybe you are better off renting a GPU server and running the inference where the data is, without round trips and you can use gpt-oss
- beering 1y agoThe 5 seconds delay is probably due to reasoning. Maybe try setting it to minimal? If your use case isn’t complex maybe reasoning is overkill and gpt-4.1 would suffice.
- darepublic 1y agoThey took away o3 on plus for this :(
- Buttons840 1y agoo3 was surprisingly good at research. I once saw it spend 6 full minutes researching something before giving an answer, and I wasn't using the "research" or "deep think" or whatever it's called, o3 just decided on its own to do that much research.
- gooodvibes 1y agoNot having the choice to use the old models is a horrible user experience. Taking 4o away so soon was a crime. I don’t feel like I got anything new, I feel like something got taken away.
- hirvi74 1y ago4o and perhaps a few other of the older models are coming back. Altman already stated so.
- pseudo_meta 1y agoAPI is noticeably slower for me, sometimes up to 10x slower. Upon some digging, it seems that part of the slowdown is due to the gpt-5 models by default doing some reasoning (reasoning effort "medium"), even for the nano or mini model. Setting the reasoning effort to "minimal" improves the speed a lot. However, to be able to set the reasoning effort you have to switch to the new Response API, which wasn't a lot of work, but more than just changing a URL.
- Tiberium 1y ago> However, to be able to set the reasoning effort you have to switch to the new Response API, which wasn't a lot of work, but more than just changing a URL. That's not true - you can switch reasoning effort in the Chat Completions API - https://platform.openai.com/docs/api-reference/chat/create https://platform.openai.com/docs/api-reference/chat/create . It's just that in Chat Completions API it's a parameter called "reasoning_effort", while in the Responses API it's a "reasoning" parameter (object) with a parameter "effort" inside.
- pseudo_meta 1y agoOh thx, must have missed that. Guess at least that saves me some time to switch to the newer API in the future.
- hirvi74 1y agoI'm noticing significant differences already. Code seems to work on the first try more often for me too. Perhaps my favorite change so far is the difference of verbosity. Some of the responses I am receiving when asking trivial questions are now are merely a handful of sentences instead of a dissertation. However, dissertation mode comes back when appropriate, which is also nice. Edit: Slightly tangential, but I forgot to ask, do any of you all have access to the $200/month plan? If so, how does that model compare to GPT-5?
- dyauspitr 1y agoIt’s the same model at the $200 price point.
- jostylr 1y agoI have been using the $200 plan the past day in CodexCli and so far find that it is easy to work with (nothing crazy, just web app stuff). The context window means I no longer have to worry about running out of room and it seems to stay on track just fine so far. I have it incrementally coding pieces in a manageable chunk to understand and verify. No limits so far as promised. In contrast, using Claude Code ($100 level) I run into limits after just a couple of iterations of asking and context window gets problematic too quite quickly. It feels like 5 isn't gobbling up as much irrelevant text as Claude does.
- al_borland 1y agoIt feels slower, but if the quality is better, so one response will do instead of multiple follow up questions, it’s still faster overall. It’s also still orders of magnitude faster than doing the research manually. I’m reminded of that Louis CK joke about people being upset about the WiFi not working on their airplane.
- BriggyDwiggs42 1y agoThere’s definitely an element of that, being too used to a very impressive technology so coming off entitled. There’s also the other side though, which is that LLM-based AI has been sort of positioned as and portrayed as a technology which will drive an utter transformation in the near future, and with gpt 5 many people are having the realization forced on them that it was all sorta nonsense, lies, motivated reasoning, exaggeration, etc.
- 486sx33 1y ago[dead]
- rolodexter2023 1y ago"ChatGPT 5" is a marketing psyop
- rolodexter2023 1y ago“Open”AI is growing more opaque and black box every day
- Tiberium 1y agoGPT-5 in the API, especially at "high" reasoning is quite a bit better than o3, especially at web design "style". Also from my own experience, and from some people I've talked with it's great at agentic programming and at finding bugs (and then fixing them, of course). ChatGPT 5 in web is a router to lots of different models [1], and the non-reasoning GPT-5 chat model ("gpt-5-chat-latest" in the API) is quite dumb - no significant difference from 4o/4.1. Even if you choose GPT-5 Thinking, there's a chance that your request will be routed to GPT-5 Mini, not to full GPT-5. The only real way to fix that in ChatGPT is to subscribe to Pro and use GPT-5 Pro, but of course that's very expensive. Otherwise people suggest saying "think hard" in the prompt, which might make the router choose the better model. Worse even, Sam Altman publicly said that in the first day of the GPT-5 release their router didn't work properly. [2] I'd suggest trying GPT-5 in API or in apps like Cursor/Windsurf if you want to truly test it. Oh, and from the GPT-5 guide [3] apparently OpenAI considers GPT-5 to be good even at "minimal" reasoning (it's still the full thinking model then, not the chat variant, and will respond much faster): > The minimal setting performs especially well in coding and instruction following scenarios, adhering closely to given directions [1] https://cdn.openai.com/pdf/8124a3ce-ab78-4f06-96eb-49ea29ffb52f/gpt5-system-card-aug7.pdf https://cdn.openai.com/pdf/8124a3ce-ab78-4f06-96eb-49ea29ffb... "Table 1: Model progressions" [2] https://x.com/sama/status/1953893841381273969 https://x.com/sama/status/1953893841381273969 "Yesterday, the autoswitcher broke and was out of commission for a chunk of the day, and the result was GPT-5 seemed way dumber" [3] https://platform.openai.com/docs/guides/latest-model https://platform.openai.com/docs/guides/latest-model
- dileeparanawake 1y agoNot sure about them peaking but I definitely feel that right now gpt-5 doesn’t feel like a game changer like the marketing says. In some things it’s worse, slower, less useful (in terms of detail not ego flattery!). My use case is mainly code and learning. I think the make everything bigger is plateauing and not yielding the infinite returns that were first suggested and demonstrated from gpt 2 - 4. I think now it’s harder because they’ve got to focus on value per watt. Smaller good models mean less energy, less complexity to go wrong, but harder to achieve. The unlock could be more techniques and focussed synthetic data from old models used to train new ones but apparently gpt-5 uses synthetic data and this is one of the reasons it isn’t necessarily good in real world tasks. For me if we go the synthetic data route it’s important to shoot for quality - good synthetic data distils useful stuff, discards the noise so useful patterns are more solid in training, but imagine it’s hard to distinguish signal from noise to produce good synthetic data.
- ManlyBread 1y agoI have used GPT-5 a few times and I genuinely can't think of a single improvement. You could stealthy deploy it in place of GPT-4 and I wouldn't be able to tell the difference.
- iwontberude 1y agoIndeed I would say wow, ChatGPT must be having issues today it’s so slow
- pelasaco 1y agoAfter 5 versions, it still not able to generate a Markdown with ```cmd``` without breaking it