4 ms·
> They don’t have GPT-5 after 14 months of trying. They didn't have GPT-4 until 3 years after GPT-3. > The most important figure in the blogpost is attached b
by Ukv 2y ago
> They don’t have GPT-5 after 14 months of trying.
They didn't have GPT-4 until 3 years after GPT-3.
> The most important figure in the blogpost is attached below. And the most important thing about the figure is that 4o is not a lot different from Turbo, which is not hugely different from 4.
The chart shows, for instance, 67% on HumanEval with GPT-4 to 90.2% to with GPT-4o. Future increments will inherently be smaller just by nature of the benchmarks - there's a hard cap of 100%, and 90%->99.9% represents far more progress than 50%->60%. Even reaching omniscience wouldn't look all that impressive on the benchmark chart.