3 ms·
I love it. It is easy to install and containerized. Its API is great if you want to integrate it with your code editor or create your own applications. I have
by bovem 3y ago
I love it. It is easy to install and containerized.
Its API is great if you want to integrate it with your code editor or create your own applications.
I have written a blog [1] on the process of deployment and integration with neovim and vscode.
I also created an application [2] to chat with LLMs by adding the context of a PDF document.
Update: I would like to add that because the API is simple and Ollama is now available on Windows I don’t have to share my GPU between multiple VMs to interact with it.
[1] https://www.avni.sh/posts/homelab/self-hosting-ollama/ https://www.avni.sh/posts/homelab/self-hosting-ollama/
[2] https://github.com/bovem/chat-with-doc https://github.com/bovem/chat-with-doc