sabaimran

7 ms·

31.
by sabaimran 3y ago
This (ollama) is neat! Thanks for the pointers. Yeah, I ran into a couple of funny edge cases using Llama v2 with my personal notes. For example, if I ever asked it anything remotely personal (as I would with a personal assistant), it would
32.
by sabaimran 3y ago
Hey ubertaco! I remember you. Appreciate the well-wishes. The landing page still needs some tweaking. It's kind of hard keeping what you're building in sync with what you're aspiring for, but we're definitely working tow
33.
by sabaimran 3y ago
We have a cloud product you can sign up for, but it's more limited in what data sources it supports. It currently only works for Notion and Github indexing. If you're interested in that, send me a dm on Discord - https:/&#x2
34.
by sabaimran 3y ago
I quite like this concept. It would be neat if you could relay the data to a personal server for processing and insight extraction. Seems feasible with phone camera. I think gopros would be limited based on battery life (in my experience).
35.
by sabaimran 3y ago
Thanks! I do think Llama V2 is going to be a good enough replacement for ChatGPT (aka GPT3.5) for a lot of use cases.
36.
by sabaimran 3y ago
Quick clarification, we are using LlamaV2 7B. We didn't experiment with Llama 1 because we weren't sure of the licensing limitations. We determine note relevance by using cosine similarity between the query and the knowledge bas
37.
by sabaimran 3y ago
It still provides really good semantic search! The search will return snippets from your raw data itself, while the LLM gives you the experience of chatting with it.
38.
by sabaimran 3y ago
Hey activatedgeek! Thanks for sharing Khoj. @110 and I are the developers. Lots of great discussion going on in this thread. Two things we want to clarify: 1. Search works offline. Chat uses OpenAI. 2. We're working on adding open sour
39.
by sabaimran 3y ago
Search does currently work 100% offline - none of your data would be sent to OpenAI if all you're doing is searching for your local documents. You could completely disable your internet connection and it would still work. Chat currentl
40.
by sabaimran 3y ago
The GPT integration only works if you pass Khoj an OpenAI key in your settings, so it's a pretty explicit opt-in. Otherwise, there's no way for Khoj to send data to OpenAI. Does that make sense?
41.
by sabaimran 3y ago
Ah, I always forget to mention. We do also index images, but haven't tested OCR. Like you could search for "bike by the lake" to get relevant images, but not search for the text within an image.
42.
by sabaimran 3y ago
I understand your concerns, but let me zoom out a little here and talk about the nature of open source. Open source means that the source code which is developed for a piece of software is fully open (i.e, anyone can read, fork, modify the
43.
by sabaimran 3y ago
1. Khoj has been around since early 2021, and both of us have been contributing to open source for several years. Being open source for a project like this just makes sense. 2. Search actually is 100% offline. It's using sentence trans
44.
by sabaimran 3y ago
Quite cool! It looks like this tool is oriented around ephemeral sessions, while Khoj is meant to be personal and local to you.
45.
by sabaimran 3y ago
Those are cool use cases! PDFs with text should work. Maybe I should try and index my download folder too :-).
46.
by sabaimran 3y ago
We already index org, markdown, and PDF files on your file system. We're adding a text connector soon, which will allow you to index any plain text files you care to. With that, you should be able to index Gmail over Maildir/POP&#
47.
by sabaimran 3y ago
Hello! One of the developers of Khoj here. The way we see it, building in the open is going to be critical for creating an aligned, trustworthy AI assistant. Note: while all LLM tools look fairly similar on the surface these days, our speci