3 ms·
I love working with Ollama, I was really surprised at how easy it is to build a simple RAG system with it. For example: https://github.com/stephen37/ollama_loca
by stephen37 2y ago
I love working with Ollama, I was really surprised at how easy it is to build a simple RAG system with it. For example: https://github.com/stephen37/ollama_local_rag https://github.com/stephen37/ollama_local_rag
- addandsubtract 2y agoNice, I've been looking out for something like this! What's Jina AI and how is it local if I need an API key for it? Also, this is the first time I'm hearing about poetry. Might be worth including in the prerequisites (unless I can just stick with pip?)
- sumedh 2y ago> What's Jina AI and how is it local if I need an API key for it? Looks like its a vector DB used for creating and looking up embeddings (vectors). LLM is the second part of RAG, the first part is having a good embedding model.
- stephen37 2y agoOh yes good point, it's because at first I was using a local embedding model and then decided to use JinaAI as they have good embeddings. Jina AI is doing different things but one of them is having embeddings and I use their English/ German embeddings as in one demo I am working with German data. You can use pip as well but yes, let me add something about Poetry in case people don't know about it :)