3 ms·
Also worth knowing about in this space is ellama: https://github.com/s-kostyaev/ellama https://github.com/s-kostyaev/ellama which uses the LLM package: https://
by regularfry 3y ago
Also worth knowing about in this space is ellama: https://github.com/s-kostyaev/ellama https://github.com/s-kostyaev/ellama which uses the LLM package: https://github.com/ahyatt/llm#ollama https://github.com/ahyatt/llm#ollama to talk to ollama, and while ellama doesn't currently support talking over the network to ollama it also doesn't look like that would be a hard thing to add (specifically there are host and port params the underlying function supports but ellama doesn't use).
- mark_l_watson 3y agoThanks, that looks good. I will trying! I already have a good eMacs setup with GPT-4 APIs, and a VSCode setup, but in the last few months I have 80% moved to using local LLMs for all my projects where LLMs are an appropriate tool.