3 ms·
Abstract the LLM calls into one layer, bundled with the prompt engineering for your use-case. Et viola, your application is now free from LLM lock-in.
by ukuina 3y ago
Abstract the LLM calls into one layer, bundled with the prompt engineering for your use-case.
Et viola, your application is now free from LLM lock-in.
- deeringc 3y agoWell, maybe at an API and prompt level. But if Google pull ahead in this space then you may become dependent on what it alone can do functionally. Even if you can trivially switch LLM and prompt, if the others aren't able to do something equivalent (or at the same level of quality) then you're still locked in. Until now we've basically had this situation with OpenAI.
- ukuina 3y agoWhy is vendor lock-in a concern if no other vendor offers that functionality?