3 ms·
seems like a really minor upgrade?
by mincer_ray 6mo ago
seems like a really minor upgrade?
- Nicholas_C 6mo agoI think they will all be minor going forward, feels like the major improvements have all been made and we'll only see incremental improvements from here on out. Maybe I'm wrong but we'll see.
- spelk 6mo agoHard to say. People made the same prediction a year ago because we supposedly ran out of training data. There could be indefinite rapid compounding improvements so long as there's free money out there.
- jmalicki 6mo agoWith RLHF and RLVR we are creating tons of new training data, that is much more focused than reading the Internet. Annotation shops are doing many billions per year in revenue creating newer data, and a lot of it is highly complex, focused on rewarding multi turn agentic trajectories.
- chandureddyvari 6mo agoWasn't Mythos a step change improvement?
- Eufrat 6mo agoI think one of the challenges is that the models were all initially trained on the entire Internet (or as much as they could gather) and now they’re having to deal with an increasing amount of the Internet being AI generated content which may be why GPT-5.5 started being obsessed with goblins and you start seeing amusing things in the system prompt trying to get the model to stop bringing them up.
- conradkay 6mo agoI think there's just less time between model releases now
- teeray 6mo agoYes, but if version number go up, so do all other number
- pmxi 6mo agoYeah. They are aware: "Users will find Opus 4.8 to be a modest but tangible improvement on its predecessor."
- scotty79 6mo agoI think we lack benchmarks that could meaningfully indicate progress. They are mostly garbage that's saturated at this point. God wouldn't score much higher in them.