4 ms·

Out of personal experience, open source LLMs did not yet reach the quality of GPT 3.5, despite multiple claims with dubious benchmarks. That said, they are alre

Out of personal experience, open source LLMs did not yet reach the quality of GPT 3.5, despite multiple claims with dubious benchmarks. That said, they are already useful as of today and can even run on your local machine. I regularly use them with my Neovim plugin gen.nvim [1] for simple tasks and they save me a lot of time. I'm excited about the future! [1]: https://github.com/David-Kunz/gen.nvim https://github.com/David-Kunz/gen.nvim

tarruda 3y ago
Very interesting. I want to give it a try, but I see that one of the dependencies is "ollama" which is a Mac App and I don't have a Mac. I'm running Llama models locally using llama-cpp-python which provides an OpenAI compatibility layer.
- rkwz 3y ago
  Oh, can install Ollama in Linux/WSL as well
- davidkunz 3y ago
  It should work on Linux and also with WSL. You could also try running it in Docker.
  - tarruda 3y ago
    I see. Does ollama have an http API (this the curl requirement)? If so, is it compatible with OpenAI API?
    - davidkunz 3y ago
      Yes, it works with an Ollama server and the communication is done via HTTP. I know that someone configured my plugin to talk to OpenAI.