4 ms·
Any plans to add Langchain support? Another thing for OSS LLMs could be adding support for the like of Replicate or Baseten as well.
by warthog 3y ago
Any plans to add Langchain support? Another thing for OSS LLMs could be adding support for the like of Replicate or Baseten as well.
- sq42na 3y agoWe actually use Langchain under the hood for some things, and are in the process of figuring out which abstractions make sense to put on the SDK interface. For example, we already use the `langchain.schema.Document` class as the main document dataclass. With making it possible to bring any LLM, we're considering adding support for bringing anything that implements the Langchain LLM interface. In general, we're still trying to figure out how much customizability to give to the user and how (Langchain is a great option here) -- power should not come at the expense of ease of use.