3 ms·

> For Plus and Pro users, we’re updating GPT‑5.6 Sol in Chat to be more reliable with facts and provide more focused answers. I was not impressed with 5.6 and

> For Plus and Pro users, we’re updating GPT‑5.6 Sol in Chat to be more reliable with facts and provide more focused answers. I was not impressed with 5.6 and this hits exactly why. Also, this instant, medium, and high slider situation we now have everywhere is batshit crazy. It’s a major step back in technology. I’ll put money on the table there will be a surprise in revenue because users have no clue what to choose, so they are constantly choosing high because they don’t want to risk getting inaccurate answers. If this was intentional by the dark patterns department, then brilliant. However, I’m guessing Anthropic and OpenAI are struggling to know how to deploy their models. Also, the models were already amazing. They need to slow down and do a model release once a year and only do extremely minor iterations instead. Some amazing things are accomplished, but how people actually want to utilize the models gets screwed up every time in the process.

qhwudbebd 2mo ago
It seems even worse than that: when you're calling the model, you have this strange two-dimensional thing with reasoning effort (specified in a small handful of random strings like "medium", "xhigh", "max") and "pro" vs "not pro" which is also somehow increasing reasoning budget, but with an interaction that is entirely opaque. How does "medium", "pro" compare with "max", "not-pro" for instance? If you're going to force people to specify manually, at least make it 0.0 - 1.0 normalised such that 0.5 is the default.
- qhwudbebd 2mo ago
  OpenRouter map this into their API in a slightly different way, making -pro and normal different model slugs, so you have openai/gpt-5.6-luna-pro vs openai/gpt-5.6-luna vs openai/gpt-5.6-sol[-pro], etc. This makes reasoning effort one-dimensional again (albeit with the arbitrary sequence of strings), but now model choice in a given generation is two-dimensional. Either way, it's hard to make any kind of informed decision.
LUmBULtERA 2mo ago
>They need to slow down and do a model release once a year and only do extremely minor iterations instead. There are a ton of use-cases where the models still struggle a lot and make bad decisions, I'd much prefer they continue their acceleration for a while more.

qhwudbebd 2mo ago

It seems even worse than that: when you're calling the model, you have this strange two-dimensional thing with reasoning effort (specified in a small handful of random strings like "medium", "xhigh", "max") and "pro" vs "not pro" which is also somehow increasing reasoning budget, but with an interaction that is entirely opaque. How does "medium", "pro" compare with "max", "not-pro" for instance? If you're going to force people to specify manually, at least make it 0.0 - 1.0 normalised such that 0.5 is the default.

qhwudbebd 2mo ago
OpenRouter map this into their API in a slightly different way, making -pro and normal different model slugs, so you have openai/gpt-5.6-luna-pro vs openai/gpt-5.6-luna vs openai/gpt-5.6-sol[-pro], etc. This makes reasoning effort one-dimensional again (albeit with the arbitrary sequence of strings), but now model choice in a given generation is two-dimensional. Either way, it's hard to make any kind of informed decision.

LUmBULtERA 2mo ago

>They need to slow down and do a model release once a year and only do extremely minor iterations instead. There are a ton of use-cases where the models still struggle a lot and make bad decisions, I'd much prefer they continue their acceleration for a while more.