4 ms·

Retrieval Augmented Generation in Go

• xrd 3y ago
  Do you have to generate embeddings with openai? I'm assuming this is the quickest and easiest way, but what's the complexity if you do this on your own hardware?
  • eliben 3y ago
    Neither of this really requires OpenAI. You can do it with locally-running models via something like https://github.com/mudler/LocalAI https://github.com/mudler/LocalAI
    • xrd 3y ago
      Terrific. I also see that Simon Wilison's LLM tool does it. https://llm.datasette.io/en/stable/embeddings/cli.html# https://llm.datasette.io/en/stable/embeddings/cli.html#
      • eliben 3y ago
        Yes, `llm` is a great tool. I believe it uses OpenAI by default but supports installing local models as plugins -- https://simonwillison.net/2023/Jul/12/llm/ https://simonwillison.net/2023/Jul/12/llm/