110

6 ms·

1.
MiniMax M2.1: Built for Real-World Complex Tasks, Multi-Language Programming(minimaxi.com)
228 points by 110 9mo ago|81 comments
2.
by 110 2y ago
Potential solutions: 1. AI video watermarks that carry over even if a video of the AI video is taken 2. Cameras that can see AI video watermarks and put an AI video watermark on the videos of any AI videos they take
3.
by 110 2y ago
Umm, customary, tongue-in-cheek reference to McCarthy's proposal for a 10 person research team to solve AI in 2 months (over the Summers)[1]. This was ~70 years ago :) Not saying we're in necessarily the same situation. But it rem
4.
by 110 3y ago
Yes, this seems to be a common concern. We're trying to see how best to crisply address it. But yes, Khoj can be used even with your internet turned off
5.
by 110 3y ago
We're still trying to figure out the right balance between configurability and ease of use/maintenance. The 7B version was a decent enough starting point in terms of what it can answer (and way fewer folks can run a 13B on their m
6.
by 110 3y ago
Yes, of course
7.
by 110 3y ago
It should work but not sure how fast. Best way to find out would be to try it. We also have some fixes and perf improvements we plan to release later today in version 0.10.1
8.
by 110 3y ago
Thanks for the feedback. Does your machine have a GPU? 32GB CPU RAM should be enough but GPU speeds up response time. We have fixes for the seg fault[1] and improvement to the query speed[2] that should be released by end of day today[3]. U
9.
by 110 3y ago
Khoj provides exactly that; it runs on your machine, none of your data leaves your machine and it has a web interface to chat
10.
by 110 3y ago
Firstly, my previous statement needs quite a lot of clarification: Khoj works more like an incremental, natural language version of org-agenda-search (or projectile) rather than isearch. You've to configure which files it should index
11.
by 110 3y ago
Khoj exposes a local API. Hopefully that makes it easy to integrate with Raycast, Alfred (or even Spotlight)?
12.
by 110 3y ago
Yeah, this would be ideal for Mac users. Just need to look into what is required and how much work it is
13.
by 110 3y ago
Thanks for the feedback! Someone else mentioned this issue the other day as well. I'll fix this issue on the landing page soon
14.
by 110 3y ago
To use Chat with non-english sources you'll need to enable OpenAI. Offline chat with Llama 2 can't do that yet. And Search can be configured to work with 50+ languages. You'll just need to configure the asymmetric search mode
15.
by 110 3y ago
Thanks! :)
16.
by 110 3y ago
Buggy for setup? We've done some improvements and have desktop apps (in beta) too now to simplify this. Feel free to report any issues on the khoj github. I can have a look. Yes, we don't do optimizations on the query encoding yet
17.
by 110 3y ago
Khoj chat with Llama2 will not work with non-english languages though. You'll have to enable OpenAI for that
18.
by 110 3y ago
Search should work with Slavic languages including Russian and 50+ other languages. You'll just need to configure the asymmetric search model khoj uses to paraphrase-multilingual-MiniLM-L12-v2 in your ~/.khoj/khoj.yml con
19.
by 110 3y ago
You do not need to break the bank to use Khoj for local chat, 16Gb RAM should be good enough
20.
by 110 3y ago
Oh yeah, I used to use Google Desktop too. It was awesome for it's time
21.
by 110 3y ago
Khoj uses Llama 2 7B, 4bit quantized. So it just needs 3.5Gb of RAM (GPU or System) [1]. Khoj and your other apps need more RAM themselves, so practically 8GB of System or GPU RAM should suffice. Khoj has been tested with CUDA and Metal cap
22.
by 110 3y ago
That would be pretty awesome. Building a daily web history summarizer as a browser extension shouldn't be too much work. I bet there's something like that already out there. Having something that indexes all your digital travels
23.
by 110 3y ago
Oh neat, thanks for sharing that! Having a 32K offline model is pretty promising. Let me test out how it performs
24.
by 110 3y ago
Ah, you're right, forgot to mention that. We use the Llama 2 7B 4 bit quantized model. The machine requirements are: Ideal: 16Gb (GPU) RAM Less Ideal: 8GB RAM and CPU
25.
by 110 3y ago
1. I hear you on going back to lightweight native apps. Unfortunately the Python ecosystem is not great for this. We use pyinstaller to create the native desktop app but it's a pain to manage. 2. The web UI isn't required if you u
26.
by 110 3y ago
That.would.be.awesome! Khoj isn't their yet, but that actually shouldn't be too far away if you give it a voice interface and terminal access. Of course, having it be stable enough to not `rm -rf /` soon after is definitely n
27.
by 110 3y ago
Thanks for the pointer, yeah the website content has gone stale. I'll try update it by end of day Khoj is using the Llama 7B, 4bit quantized, GGML by TheBloke. It's actually the first offline chat model that gives coherent answers
28.
by 110 3y ago
Yeah being able to search and chat with PDF files is quite useful. Khoj can index directory of PDFs for search and chat. But it does not currently work with scanned PDF files (i.e not with ones without selectable text). Being able to work w
29.
by 110 3y ago
Wow that's an intense use-case. I don't know how but we'd love to be able to support this. If you can collate your notes into markdown or some such, then messy notes can be handled, at least using Khoj with GPT3.5+. Do let us
30.
by 110 3y ago
2.5 years! We're kind of slow :P

More ›