3 ms·
notice the langchainrb gem[0] does have an ollama provider[1]. It might be overkill for your needs tho. [0] https://github.com/ttilberg/langchainrb https://gi
by riffraff 3y ago
notice the langchainrb gem[0] does have an ollama provider[1].
It might be overkill for your needs tho.
[0] https://github.com/ttilberg/langchainrb https://github.com/ttilberg/langchainrb
[1] https://github.com/ttilberg/langchainrb/blob/main/lib/langchain/llm/ollama.rb https://github.com/ttilberg/langchainrb/blob/main/lib/langch...
- lolinder 3y agoI tried using langchain's Ollama provider but for my use case it was strictly worse than just using Ollama directly. Ollama builds a conversation context automatically that langchain provides no handle for, and the context langchain encourages you to build isn't as useful because it forces Ollama to re-process the full context each time, whereas the native Ollama context represents the current state of inference. The other kinds of non-conversational context that I needed were trivial to put together myself, so for my use case langchain just got in the way. Ollama's API was already trivial to wrap myself.