3 ms·

Models that you can run at home (Like Qwen 35B) aren't remotely close to Opus or GPT 5.5. Not even close. The only open models that are in that neighbor are aro

by redox99 4mo ago

Models that you can run at home (Like Qwen 35B) aren't remotely close to Opus or GPT 5.5. Not even close. The only open models that are in that neighbor are around 1T params, so forget about running at home. It's kind of like driving a shitbox. It can often drive you from A to B, and some people will try to convince you it's fine. It's not. There's no logical reason other than absolutely requiring the privacy, doing it for fun, or niche use cases like airplanes and so on. If you can't spend the insanely subsidized $20 for codex, you can use an API for chinese models which will run circles around these tiny models.

pbasista 4mo ago
> Models that you can run at home (Like Qwen 35B) aren't remotely close to Opus or GPT 5.5. Is that characterization based on some objective facts or benchmarks?
- redox99 4mo ago
  Based on private test prompts I've run through OpenRouter.
- kube-system 4mo ago
  Yes, there aren't any 35B models that are beating frontier models at just about anything generalized
xgulfie 4mo ago
I don't need a Ferrari to get to work
- orangeisthe 4mo ago
  But you need the best tools to do the job
  - gr_norm 4mo ago
    You need tools sufficient to do the job in an economical way, optimizing for both cost and quality. That is what 'best' means. We don't give every engineer all the resources under the sun, only what is appropriate. I suspect many will realize millions more dollars are being spent than needed to achieve the highest marginal productivity gains, and reallocate accordingly. Who wants more of their money going to developer tooling, rather than bonuses?
    - orangeisthe 4mo ago
      Of course. I have a $20/mo Codex subscription that has been serving me very well. Occasionally when I run out of quota, I switch to another one of my backup $20/mo subscription. That's way more economical and produces far better result than any self hosted models today.

by redox99 4mo ago

pbasista 4mo ago

> Models that you can run at home (Like Qwen 35B) aren't remotely close to Opus or GPT 5.5. Is that characterization based on some objective facts or benchmarks?

redox99 4mo ago
Based on private test prompts I've run through OpenRouter.
kube-system 4mo ago
Yes, there aren't any 35B models that are beating frontier models at just about anything generalized

xgulfie 4mo ago

I don't need a Ferrari to get to work

orangeisthe 4mo ago
But you need the best tools to do the job
- gr_norm 4mo ago
  You need tools sufficient to do the job in an economical way, optimizing for both cost and quality. That is what 'best' means. We don't give every engineer all the resources under the sun, only what is appropriate. I suspect many will realize millions more dollars are being spent than needed to achieve the highest marginal productivity gains, and reallocate accordingly. Who wants more of their money going to developer tooling, rather than bonuses?
  - orangeisthe 4mo ago
    Of course. I have a $20/mo Codex subscription that has been serving me very well. Occasionally when I run out of quota, I switch to another one of my backup $20/mo subscription. That's way more economical and produces far better result than any self hosted models today.