3 ms·

Is there any LLM from exactly one year ago that would be worth running? In Aug 2025 you had - OpenAI o3 - Opus 4.1 - Gemini 2.5 Pro - Grok 4 Even if those

by redox99 2mo ago

Is there any LLM from exactly one year ago that would be worth running? In Aug 2025 you had - OpenAI o3 - Opus 4.1 - Gemini 2.5 Pro - Grok 4 Even if those were almost free to run, you'd be way better off with Deepseek flash 0731 or GPT 5.6 Luna, which already are almost free. Other than for things where the t/s are critical, it seems like a bad idea to etch a model into silicon.

daishi55 2mo ago
That is fkin wild. o3 was just a year ago? The progress is truly insane.
- redox99 2mo ago
  Yeah I had to double check, o3 feels like it was ages ago. But GPT 5 came out Aug 7, so it's only one day off from my 1 year ago cutoff!
mdp2021 2mo ago
> Is there any LLM from exactly one year ago that would be worth running? Bad perspective: consider the correction: "when are thresholds of sought quality reached"? Hence: not "is there a 10yo from last year that could compete with the current 13yo", but "will there be a 30(?)yo from last year that could compete with the current 33(?)yo" ('(?)': the scale of yearly growth in the future is uncertain).
- redox99 2mo ago
  It's not just about it "being smart enough". It's about there being actual user demand when it needs to compete with the shiny new model. A 10 year old iPhone is probably good enough, but is there demand for it? In a vacuum a 10 year old iPhone is good, but why would you pick it if you can have a current one for a reasonable price?
  - mdp2021 2mo ago
    If you have a 2 years old item working and the new 2 months old item offers little advantage over the old one, and its cost is nonzero, an important part of the aggregate demand will stick with the old one... So, when the models will be "good enough", you will probably use one as the "daily driver" for a long time for consolidated workflows (some of them enabled by the staggering collateral advantages of specialized hardware and obvious advantages of local hardware), and occasionally use other available models for exceptional tasks, and upgrade only when definitely advantageous - like normal goods.
singingtoday 2mo ago
We still run GPT 4.1 for some of our use cases. We want to replace it but are having trouble finding models that are as fast with similar or better intelligence.
- redox99 2mo ago
  There's nothing fast about GPT 4.1. It's ~50 tps AFAIK. Of course it doesn't use reasoning, but you can run modern models without thinking as well. GPT 5.6 Sol without reasoning should destroy it in intelligence.
itgoon 2mo ago
Gemini 2.5 Pro was very good at writing single, somewhat complex functions. Sure, the rest of the loop would still take time, but nearly-instant implementation? Sign me up.
anentropic 2mo ago
What if it was Fable 5 baked in?

by redox99 2mo ago

daishi55 2mo ago

That is fkin wild. o3 was just a year ago? The progress is truly insane.

redox99 2mo ago
Yeah I had to double check, o3 feels like it was ages ago. But GPT 5 came out Aug 7, so it's only one day off from my 1 year ago cutoff!

mdp2021 2mo ago

> Is there any LLM from exactly one year ago that would be worth running? Bad perspective: consider the correction: "when are thresholds of sought quality reached"? Hence: not "is there a 10yo from last year that could compete with the current 13yo", but "will there be a 30(?)yo from last year that could compete with the current 33(?)yo" ('(?)': the scale of yearly growth in the future is uncertain).

redox99 2mo ago
It's not just about it "being smart enough". It's about there being actual user demand when it needs to compete with the shiny new model. A 10 year old iPhone is probably good enough, but is there demand for it? In a vacuum a 10 year old iPhone is good, but why would you pick it if you can have a current one for a reasonable price?
- mdp2021 2mo ago
  If you have a 2 years old item working and the new 2 months old item offers little advantage over the old one, and its cost is nonzero, an important part of the aggregate demand will stick with the old one... So, when the models will be "good enough", you will probably use one as the "daily driver" for a long time for consolidated workflows (some of them enabled by the staggering collateral advantages of specialized hardware and obvious advantages of local hardware), and occasionally use other available models for exceptional tasks, and upgrade only when definitely advantageous - like normal goods.

singingtoday 2mo ago

We still run GPT 4.1 for some of our use cases. We want to replace it but are having trouble finding models that are as fast with similar or better intelligence.

redox99 2mo ago
There's nothing fast about GPT 4.1. It's ~50 tps AFAIK. Of course it doesn't use reasoning, but you can run modern models without thinking as well. GPT 5.6 Sol without reasoning should destroy it in intelligence.

itgoon 2mo ago

Gemini 2.5 Pro was very good at writing single, somewhat complex functions. Sure, the rest of the loop would still take time, but nearly-instant implementation? Sign me up.

anentropic 2mo ago

What if it was Fable 5 baked in?