4 ms·
For those who like open source so much they want to use a provider
by ctdinjeu5 6mo ago
For those who like open source so much they want to use a provider
- exe34 6mo agoCould you explain the incompatibility? These seem like orthogonal axes to me.
- ctdinjeu5 6mo agoJust a joke, but you’re right I can like open source and not want to self host
- avaer 6mo agoI think this is the majority view.
- fifthace 6mo agoIf rumours OpenAI are doing 70% margins on inference and Anthropic doing 30% margins, then open weights models hosted on clouds happy with 10% margins increase competition and decrease cost. I’m game, like most. Much easier compliance with data sovereign concerns too.
- zozbot234 6mo ago> OpenAI are doing 70% margins on inference and Anthropic doing 30% margins That difference is actually pretty surprising. Is Claude that much more expensive to host? The end-user pricing seems to be pretty similar, or better for OpenAI.
- Demiurge 6mo agoIt should be at least cheaper if anyone can host it, no?
- adrian_b 6mo agoWhile I would not use an external provider, that may be a rational choice for some. The most important advantage of using open weights models is to have perfectly predictable performances and costs in the future. When you can run the model on your own hardware you are protected from price increases, subscription limits decreases or quality reductions of the provided models, like it has already happened for the users of Claude Code. The disadvantage is that if you also want a high speed, you need more expensive hardware. You may defer the cost of buying better hardware, if you use an external provider for now, but you keep in reserve the possibility of hosting yourself the models that you are using, if anything makes the external providers worse.