3 ms·
As others have mentioned you're ignoring the long tail of open-weights models which can be self hosted. As long as that quasi-open-source competition keeps up t
by Schlagbohrer 6mo ago
As others have mentioned you're ignoring the long tail of open-weights models which can be self hosted. As long as that quasi-open-source competition keeps up the pace, it will put a cap on how expensive the frontier models can get before people have to switch to self-hosting.
That's a big if, though. I wish Meta were still releasing top of the line, expensively produced open-weights models. Or if Anthropic, Google, or X would release an open mini version.
- Wowfunhappy 6mo agoWell, Google does release mini open versions of their models. https://deepmind.google/models/gemma/gemma-4/ https://deepmind.google/models/gemma/gemma-4/
- deaux 6mo agoAnd they're incredibly good for their size.
- boppo1 6mo agoWhich, unfortunately is still slow unusable garbage compared to fronteir models.
- deaux 6mo agoNot at all, it's more than enough for a large range of tasks. As for slow, that's just a function of how much compute you throw at it, which you actually control unlike with closed weights models.
- kridsdale1 6mo agoDepends on your hardware.