4 ms·
I had preview access for a couple of weeks. I've written up my initial notes so far, focusing on core model characteristics, pricing (extremely competitive) and
by simonw 1y ago
I had preview access for a couple of weeks. I've written up my initial notes so far, focusing on core model characteristics, pricing (extremely competitive) and lessons from the model card (aka as little hype as possible): https://simonwillison.net/2025/Aug/7/gpt-5/ https://simonwillison.net/2025/Aug/7/gpt-5/
- dang 1y agoRelated ongoing thread: GPT-5: Key characteristics, pricing and model card - https://news.ycombinator.com/item?id=44827794 https://news.ycombinator.com/item?id=44827794
- jaccola 1y agoOut of interest, how much does the model change (if at all) over those 2 weeks? Does OpenAI guarantee that if you do testing from date X, that is the model (and accompaniments) that will actually be released? I know these companies do "shadow" updates continuously anyway so maybe it is meaningless but would be super interesting to know, nonetheless!
- simonw 1y agoIt changed quite a bit - we got new model IDs to test every few days. They did tell us when the model was "frozen", and I ran my final tests against those IDs. OpenAI and Anthropic don't update models without changing their IDs, at least for model IDs with a date in them. OpenAI do provide some aliases, and their gpt-5-chat-latest and chatgpt-4o-latest model IDs can change without warning, but anything with a date in (like gpt-5-2025-08-07) stays stable.
- BryantD 1y agoIn the interests of gathering these pre-release impressions, here's Ethan Mollick's writeup: https://www.oneusefulthing.org/p/gpt-5-it-just-does-stuff https://www.oneusefulthing.org/p/gpt-5-it-just-does-stuff Thank you to Simon; your notes are exactly what I was hoping for.
- candiddevmike 1y agoThis post seems far more marketing-y than your previous posts, which have a bit more criticality to them (such as your Gemini 2.5 blog post here: https://simonwillison.net/2025/Jun/17/gemini-2-5/ https://simonwillison.net/2025/Jun/17/gemini-2-5/). You seem to gloss over a lot of GPT-5's shortcomings and spend more time hyping it than other posts. Is there some kind of conflict of interest happening?
- camgunz 1y agoFrom the guidelines: Please don't post insinuations about astroturfing, shilling, brigading, foreign agents, and the like. It degrades discussion and is usually mistaken. If you're worried about abuse, email hn@ycombinator.com and we'll look at the data.
- dcreater 1y agoYes I noticed the same. This is very concerning
- drewbitt 1y agoI am seeing the conflict from other tech influencers who were given early access or even invited to OpenAI events pre-release.
- nilsherzig 1y ago> In my own usage I’ve not spotted a single hallucination yet Did you ask it to format the table a couple paragraphs above this claim after writing about hallucinations? Because I would classify the sorting mistake as one
- simonw 1y agoThat wasn't a hallucination, that was it failing to sort things correctly.
- nilsherzig 1y agoSo a hallucination would have been if it made up a new row? What about the „9.9 / 9.11“ example? It’s unclear to me where to draw the line between skill issue and hallucination. I image that one influences the other?