3 ms·
Does it introduce more lines of code? Yes Does it introduce features that you don't need to implement yourself? Yes Does it make it easy to drop OpenAI? Yes
by hospitalJail 3y ago
Does it introduce more lines of code? Yes
Does it introduce features that you don't need to implement yourself? Yes
Does it make it easy to drop OpenAI? Yes
What's the problem?
- teaearlgraycold 3y agoYou'll still need to re-tune your prompt and the hyperparameters when switching models. So the actual effort of switching models is not improved much if at all.
- celestialcheese 3y agoThis. I'll still use langchain for token/cost counting and some nice abstractions on top of the LLM, and the document loader system is semi-useful, but all of the retriever/chain stuff abstracts away the most important part - the prompt.
- Tostino 3y agoI've tried to switch out prompts between LLM's and I've had to change every bit of code provided by laying chain with a different implementation between them. It is an entirely useless abstraction. The prompt template is not at all transferrable.
- redox99 3y agoHopefully as LLMs get smarter, you'll need less prompt engineering and stuff will "just work" across models.