2 ms·
> a local wikipedia dump There exists (at least) a project to train and query an LLM on local documents: privateGPT - https://github.com/imartinez/privateGPT h
by mdp2021 3y ago
> a local wikipedia dump
There exists (at least) a project to train and query an LLM on local documents: privateGPT - https://github.com/imartinez/privateGPT https://github.com/imartinez/privateGPT
It should provide links to the the source with the relevant content, to check the exact text:
> You'll need to wait 20-30 seconds (depending on your machine) while the LLM model consumes the prompt and prepares the answer. Once done, it will print the answer and the 4 sources it used as context from your documents
You will have noticed, in that first sentence, that it may not be practical, especially on an Orange Pi.