alexpinel

4 ms·

1.
by alexpinel 2y ago
Yes! Of course because the LLM is running locally it is not as advanced as bigger models like Claude or GPT, but you can definately quiz the documents. From my experience it performs better with specific questions rather than more ambigous
2.
by alexpinel 2y ago
Right now the minimum amount of RAM I would recommend is 16gb, I think it can run with less memory but that will require a few changes here and there (although they might reduce performance). I would also strongly recommend using a GPU over
3.
by alexpinel 2y ago
Hi! I'm the guy who made Dot. I remember experimenting with a few different vector stores in the early stages of the project but decided to settle with FAISS. I mainly chose it because it made it easy to perform the whole embedding pro
4.
by alexpinel 2y ago
With those settings I would recommend GPU. CUDA acceleration really makes it faster, but keep in mind the CUDA toolkit 12.2 install will be a some 3-4gb
5.
by alexpinel 3y ago
thanks! right now it runs on Apple Silicon and Windows, it works far better with a GPU on PC but should also work with CPU if there is enough RAM. Although some people have mentioned there are some issues with the Windows app so I am lookin
6.
by alexpinel 3y ago
Hi! Really happy to see my project being posted around, please feel free to give feedback or ask any questions! :)
7.
Open source standalone app to train an AI with your documents locally on device(dotapp.uk)
2 points by alexpinel 3y ago|0 comments
8.
Open source alternative to Nvidia's Chat with RTX(dotapp.uk)
1 points by alexpinel 3y ago|1 comments
9.
by alexpinel 3y ago
Little project I have been working on, Dot is a standalone app that allows users to run an LLM locally and create a custom AI trained with documents.
10.
by alexpinel 3y ago
This free desktop app allows to perform RAG with Mistral 7B fully locally, very simple to use and seems to work well on my M1 Pro mac
11.
Dot, a free standalone app to train Mistral 7B LLM with your documents locally(dotapp.uk)
4 points by alexpinel 3y ago|2 comments
12.
Free standalone app to run RAG with Mistral 7B LLM(dotapp.uk)
2 points by alexpinel 3y ago|1 comments
13.
by alexpinel 3y ago
Here is a little pet project of mine, it is a standalone electron js app meant to run a packaged version of Mistral 7B with a focus on loading and interacting with docs in a fully local environment, kinda like a mini chat with RTX. Runs wel