2 ms·
I think any decent company would be using LLMs through an interface, so they can swap out providers, same as any API.
by esafak 2y ago
I think any decent company would be using LLMs through an interface, so they can swap out providers, same as any API.
- cm2187 2y agoThat's fair, but different LLM behave differently, so you would have to redo your testing from scratch if you were to swap the model. I think that would be the primary problem.
- esafak 2y agoTesting for LLMs is an evolving practice but you need to have tests even if you stick with one provider, otherwise you won't be able to swap out models safely within that provider either.