5 ms·

Another day, another hn thread of "this model changes everything" followed immediately by a reply stating "actually I have the literal opposite experience and f

by jahsome 8mo ago

Another day, another hn thread of "this model changes everything" followed immediately by a reply stating "actually I have the literal opposite experience and find competitor's model is the best" repeated until it's time to start the next day's thread.

malshe 8mo ago
This pretty accurately summarizes all the long discussions about AI models on HN.
wasmainiac 8mo ago
[flagged]
- BoredPositron 8mo ago
  When you keep his ramblings on twitter or company blog in mind I bet he is a shit poster here.
- locknitpicker 8mo ago
  > All anonymous as well. Who are making these claims? script kiddies? sr devs? Altman? You can take off your tinfoil hat. The same models can perform differently depending on the programming language, frameworks and libraries employed, and even project. Also, context does matter, and a model's output greatly varies depending on your prompt history.
  - andrepd 8mo ago
    It's hardly tinfoil to understand that companies riding a multi-trillion dollar funding wave would spend a few pennies astroturfing their shit on hn. Or overfit to benchmarks that people take as objective measurements.
- nocman 8mo ago
  > Who are making these claims? script kiddies? sr devs? Altman? AI agents, perhaps? :-D
clhodapp 8mo ago
And of course the benchmarks are from the school of "It's better to have a bad metric than no metric", so there really isn't any way to falsify anyone's opinions...
cactusplant7374 8mo ago
Hourly occurrence on /r/codex. Model astrology is about the vibes.
StephenHerlihyy 8mo ago
What amazes me the most is the speed at which things are advancing. Go back a year or even a year before that and all these incremental improvements have compounded. Things that used to require real effort to consistently solve, either with RAGs, context/prompt engineering, have become… trivial. I totally agree with your point that each step along the way doesn’t necessarily change that much. But in the aggregate it’s sort of insane how fast everything is moving.
- Rudybega 8mo ago
  The denial of this overall trend on here and in other internet spaces is starting to really bother me. People need to have sober conversations about the speed of this increase and what kind of effects it's going to have on the world.
  - deleted 8mo ago
    [deleted]
  - szundi 8mo ago
    [dead]
  - theLiminator 8mo ago
    Yeah, I really didn't believe in agentic coding until December, that was where it took off from being slightly more useful than hand crafting code to becoming extremely powerful.
  - girvo 8mo ago
    The effects when extrapolated out aren’t good, IMO. Certainly bad for me, a mid 30s software engineer who’s been doing this for nearly 20 years…
SatvikBeri 8mo ago
I use Claude Code every day, and I'm not certain I could tell the difference between Opus 4.5 and Opus 4.0 if you gave me a blind test

by jahsome 8mo ago

malshe 8mo ago

This pretty accurately summarizes all the long discussions about AI models on HN.

wasmainiac 8mo ago

[flagged]

BoredPositron 8mo ago
When you keep his ramblings on twitter or company blog in mind I bet he is a shit poster here.
locknitpicker 8mo ago
> All anonymous as well. Who are making these claims? script kiddies? sr devs? Altman? You can take off your tinfoil hat. The same models can perform differently depending on the programming language, frameworks and libraries employed, and even project. Also, context does matter, and a model's output greatly varies depending on your prompt history.
- andrepd 8mo ago
  It's hardly tinfoil to understand that companies riding a multi-trillion dollar funding wave would spend a few pennies astroturfing their shit on hn. Or overfit to benchmarks that people take as objective measurements.
nocman 8mo ago
> Who are making these claims? script kiddies? sr devs? Altman? AI agents, perhaps? :-D

clhodapp 8mo ago

And of course the benchmarks are from the school of "It's better to have a bad metric than no metric", so there really isn't any way to falsify anyone's opinions...

cactusplant7374 8mo ago

Hourly occurrence on /r/codex. Model astrology is about the vibes.

StephenHerlihyy 8mo ago

What amazes me the most is the speed at which things are advancing. Go back a year or even a year before that and all these incremental improvements have compounded. Things that used to require real effort to consistently solve, either with RAGs, context/prompt engineering, have become… trivial. I totally agree with your point that each step along the way doesn’t necessarily change that much. But in the aggregate it’s sort of insane how fast everything is moving.

Rudybega 8mo ago
The denial of this overall trend on here and in other internet spaces is starting to really bother me. People need to have sober conversations about the speed of this increase and what kind of effects it's going to have on the world.
- deleted 8mo ago
  [deleted]
- szundi 8mo ago
  [dead]
- theLiminator 8mo ago
  Yeah, I really didn't believe in agentic coding until December, that was where it took off from being slightly more useful than hand crafting code to becoming extremely powerful.
- girvo 8mo ago
  The effects when extrapolated out aren’t good, IMO. Certainly bad for me, a mid 30s software engineer who’s been doing this for nearly 20 years…

SatvikBeri 8mo ago

I use Claude Code every day, and I'm not certain I could tell the difference between Opus 4.5 and Opus 4.0 if you gave me a blind test