6 ms·
First impression of GPT-4.5: 1. It is very very slow, for some applications where you want real time interactions is just not viable, the text attached below t
by jampa 2y ago
First impression of GPT-4.5:
1. It is very very slow, for some applications where you want real time interactions is just not viable, the text attached below took 7s to generate with 4o, but 46s with GPT4.5
2. The style it writes is way better: it keeps the tone you ask and makes better improvements on the flow. One of my biggest complaints with 4o is that you want for your content to be more casual and accessible but GPT / DeepSeek wants to write like Shakespeare did.
Some comparisons on a book draft: GPT4o (left) and GPT4.5 (green). I also adjusted the spacing around the paragraphs, to better diff match. I still am wary of using ChatGPT to help me write, even with GPT 4.5, but the improvement is very noticeable.
https://i.imgur.com/ogalyE0.png https://i.imgur.com/ogalyE0.png
- remus 2y ago> It is very very slow Could that be partially due to a big spike in demand at launch?
- jampa 2y agoPossibly, repeating the prompt I got a much higher speed, taking 20s on average now, which is much more viable. But that remains to be seen when more people start using this version in production.
- deleted 2y ago[deleted]
- jedberg 2y agoOh yeah, that right side version is WAY better, and sounds much more like a human.
- MichaelZuo 2y agoHow does it compare with o1 and o3 preview?
- jampa 2y agoo3 is okay for text checking but has issues following the prompt correctly, same as o1 and DeepSeek R1, I feel that I need to prompt smaller snippets with them. Here is the o3 vs a new run of the same text in GPT 4.5 https://www.diffchecker.com/ZEUQ92u7/ https://www.diffchecker.com/ZEUQ92u7/
- MichaelZuo 2y agoThanks, though it says o1 on the page, is that a typo?
- FergusArgyll 2y agoI opened your link in a new tab and looked at it a couple minutes later. By then I forgot which was o and which was .5 I honestly couldn't decide which I prefer
- niek_pas 2y agoI definitely prefer the 4.5, but that might just be because it sounds 'less like ChatGPT', ironically.
- sdesol 2y agoIt just feels natural to me. The person knows the language but they are not trying to sound smart by using words that might have more impact "based on the words dictionary definition" GPT 4.5 does feel like it is a step forward in producing natural language, and if they use it to provide reinforcement learning, this might have significant impact in the future smaller models.
- rl3 2y ago>1. It is very very slow, ... below took 7s to generate with 4o, but 46s with GPT4.5 This is positively luxurious by o1-pro standards which I'd say average 5 minutes. That said I totally agree even ~45s isn't viable for real-time interactions. I'm sure it'll be optimized. Of course, my comparing it to the highest-end CoT model in [publicly-known] existence isn't entirely fair since they're sort of apples and oranges.
- philomath_mn 2y agoI paid for pro to try `o1-pro` and I can't seem to find any use case to justify the insane inference time. `o3-mini-high` seems to do just as well in seconds vs. minutes.
- azinman2 2y agoWhat are you doing with it? For me deep research tasks are where 5 minutes is fine, or something really hard that would take me way more time myself.
- philomath_mn 2y agoI usually throw a lot of context at it and have it write unit tests in a certain style or implement something (with tests) according to a spec. But the o3-mini-high results have been just as good. I am fine with Deep Research taking 5-8 minutes, those are usually "reports" I can read whenever.
- dingnuts 2y agoI bet I can generate unit tests just as fast and for a fraction of the cost, and probably less typing, with a couple vim macros
- philomath_mn 2y agoIdk, it is pretty good a generating synthetic data and recognizing the different logic branches to exercise. Not perfect, but very helpful.
- thfuran 2y ago>One of my biggest complaints with 4o is that you want for your content to be more casual and accessible but GPT / DeepSeek wants to write like Shakespeare did. Well, maybe like a Sophomore's bumbling attempt to write like Shakespeare.
- ChiefNotAClue 2y agoRight side, by a large margin. Better word choice and more natural flow. It feels a lot more human.
- rossant 2y agoIs there really no way to prompt GPT4o to use a more natural and informal tone matching GPT4.5's?
- kristianp 2y agoHow do the two versions match so closely? They have the same content in each paragraph, just worded slightly differently. I wouldn't expect them to write paragraphs that match in size and position like that.
- princealiiiii 2y agoHonestly, feels like a second LLM just reworded the response on the left-side to generate the right-side response.
- throwaway314155 2y agoIf you use the "retry" functionality in ChatGPT enough, you will notice this happens basically all the time.
- kumarm 2y agoThank you. This is the best example of comparison I have seen so far.
- reassess_blind 2y agoWhat’s the deal with Imgur taking ages to load? Anyone else have this issue in Australia? I just get the grey background with no content loaded for 10+ seconds every time I visit that bloated website.
- osigurdson 2y agoI'm wondering if generative AI will ultimately result in a very dense / bullet form style of writing. What we are doing now is effectively this: bullet_points' = compress(expand(bullet_points)) We are impressed by lots of text so must expand via LLM in order to impress the reader. Since the reader doesn't have time or interest to read the content they must compress it back into bullet points / quick summary. Really, the original bullet points plus a bit more thinking would likely be a better form of communication.
- anon373839 2y agoThat’s what Axios does. For ordinary events coverage, it’s a great style.
- not_a_bot_4sho 2y agoI'm reminded of this great comic https://marketoonist.com/2023/03/ai-written-ai-read.html https://marketoonist.com/2023/03/ai-written-ai-read.html
- dyauspitr 2y agoImgur might be the worst image hosting site I’ve ever experienced. Any interaction with that page results in switching images and big ads and they hijack the back button. Absolutely terrible. How far they’ve fallen from when it first began.
- bradley13 2y agoI use 4o mostly in German, so YMMV. However, I find a simple prompt controls the tone very well. "This should be informal and friendly", or "this should be formal and business-like".
- muzani 2y agoIn my experience, Gemini Flash has been the best at writing, and GPT 3.5 onwards has been terrible. GPT-3 and GPT-2 were actually remarkably good at it, arguably better than a skilled human. I had a bit of fun ghostwriting with these and got a little fan base for a while. It seems that GPT-4.5 is better than 4 but it's nowhere near the quality of GPT-3 davinci. Davinci-002 has been nerfed quite a bit, but in the end it's $2/MTok for higher quality output. It's clear this is something users want, but OpenAI and Anthropic seem to be going in the opposite direction.
- vessenes 2y agoSimilar reaction here. I will also note that it seems to know a lot more about me than previous models. I’m not sure if this is a broader web crawl, more space in the model, or more summarization of our chats or a combination, but I asked it to psychoanalyze a problem I’m having in the style of Jacques lacan and it was genuinely helpful and interesting, no interview required first; it just went right at me. To borrow an iain banks word, the “fragre” def feels improved to me. I think I will prefer it to o1 pro, although I haven’t really hammered on it yet.