3 ms·
There are huge economy of scale benefits from providing hosted models. I've been trying out all sorts of open models, and some of them are really impressive -
by simonw 3y ago
There are huge economy of scale benefits from providing hosted models.
I've been trying out all sorts of open models, and some of them are really impressive - but for my deployed web apps I'm currently sticking with OpenAI, because the performance and price I get from their API is generally much better than I can get for open models.
If Mistral offered a hosted version which didn't have any spin-up time and was price competitive with OpenAI I would be much more likely to build against their models.
- quickthrower2 3y agoThis only is defensible for closed models though.