3 ms·
Suppose I’ve written code that calls the OpenAI API. Is there some library that helps me easily switch to a local/other LLM. I.e a library that (ideally) provid
by d4rkp4ttern 3y ago
Suppose I’ve written code that calls the OpenAI API. Is there some library that helps me easily switch to a local/other LLM. I.e a library that (ideally) provides the same OpenAI interface for several models, or if not then at least the same interface.
- monkeydust 3y agoLangchain might be what you need.
- fortydegrees 3y agoThere's the OpenedAI-API extension for text-generation-webui: https://github.com/oobabooga/text-generation-webui/tree/main/extensions/openai https://github.com/oobabooga/text-generation-webui/tree/main...
- bart_spoon 3y agoLangchain offers abstraction across many LLMs, including OpenAI’s.
- d4rkp4ttern 3y agoFound a couple others that do something like this. Turns out I had bookmarked them a while ago. https://github.com/r2d4/openlm https://github.com/r2d4/openlm https://github.com/hyperonym/basaran https://github.com/hyperonym/basaran
- abrichr 3y agohttps://github.com/nomic-ai/gpt4all https://github.com/nomic-ai/gpt4all
- chaoyu 3y agoOpenLLM plan to provide an OpenAI-compatible API, which allows you to even use OpenAI's python client to talk to OpenLLM, user just need to change to Base URL to point to your OpenLLM server. This feature is working-in-progress.