3 ms·
I suppose this app despite running locally will also be heavily censored. Is there some local chatbot application like this, for Windows, that isn't hell to se
by vdaea 3y ago
I suppose this app despite running locally will also be heavily censored.
Is there some local chatbot application like this, for Windows, that isn't hell to set up and that is not censored?
- dvngnt_ 3y agoit uses Mistral or Llama 2
- theshrike79 3y agohttps://lmstudio.ai https://lmstudio.ai You can use it to directly search any models, download and run 100% locally. M-series Macs are the simplest, they Just Work. Even faster if you tick the GPU box. Windows needs the right kind of GPU to get workable speed.
- thejohnconway 3y agoCan that interact with files on your computer, like they show in the video?
- operator-name 3y agoLast time I used it, LM Studio doesn't include RAG.
- mrdatawolf 3y agoI just installed it yesterday and you are right it does not seem to have RAG but you can use something like anythingLLM to do the rag work and ut has built in integration with studio LM.
- purpleflame1257 3y agoYou can start with Kobold.cpp which should handhold you through the process.
- fortran77 3y agoTrying it now. Doesn't seem censored to me.
- Const-me 3y agoYou could try my Mistral implementation: https://github.com/Const-me/Cgml/blob/master/Mistral/MistralChat/Readme.md https://github.com/Const-me/Cgml/blob/master/Mistral/Mistral...