3 ms·
> Especially now that people have realized that calling the OpenAI API is going to work better than dedicating a team to tuning your own BERT model. At 100x th
by dontlikeyoueith 2y ago
> Especially now that people have realized that calling the OpenAI API is going to work better than dedicating a team to tuning your own BERT model.
At 100x the operating cost.
If you have any kind of scale, using a model that's appropriately sized to your task is going to be better.
- dewey 2y ago> If you have any kind of scale I think that's the key also in terms of team size, if you don't have a dedicated team to take care of training / running a model then it makes sense to use an existing API and pay for it until you have enough scale.
- reaperman 2y agoGemma2 might be good enough for a drop-in option as well. The benefit for those who built on ChatGPT API is that as more open weight models get released, they can silently migrate their API usage to self-hosted models … ChatGPT allowed them to prove product-market fit early!
- dontlikeyoueith 2y agoThat is a fair point. Lots of times building the inefficient thing to prove market value is better than building the scalable thing that doesn't solve anyone's problems.