3 ms·
LangChain supports local LLMs like Llama 2 with Ollama (https://github.com/jmorganca/ollama https://github.com/jmorganca/ollama) as of this morning, in both the
by jmorgan 3y ago
LangChain supports local LLMs like Llama 2 with Ollama (https://github.com/jmorganca/ollama https://github.com/jmorganca/ollama) as of this morning, in both their Python and Javascript versions:
https://python.langchain.com/docs/integrations/llms/ollama https://python.langchain.com/docs/integrations/llms/ollama
This can be a great option if you'd like to keep your data local versus submitting it to a cloud LLM, with the added benefit of saving costs if you're submitting many questions in a row (e.g. in batches)
- mtricot 3y agoI am sure we can build something around that. Going to take a look at it. Thanks for mentioning it.
- hnhg 3y agoThanks. How would this differ from running Llama2 through the Huggingface-Langchain integration? I haven't tried it but it looked like the way to go until you shared this.
- zwaps 3y agoThis one is for Mac
- wahnfrieden 3y agoHuggingface launched swift/mac today or in recent days
- bestcoder69 3y agoHow well does it work?
- zarazas 3y agoCan llama 2 also be used to create the embeddings?