3 ms·

Many LLMs may be run locally with GPT4All... https://gpt4all.io/ https://gpt4all.io/

• nickpsecurity 3y ago
  And MLC puts them on your phone, too. https://llm.mlc.ai/ https://llm.mlc.ai/
• slowmovintarget 3y ago
  GPT4All makes it annoyingly difficult to run any other than their "approved" models. I'd like to kick the tires on a whole host of random GGUF quantizations on Hugging Face, please. I've poked around the doc, not sure if Jan can do that better. In the mean time, I use text-gen-ui (Oobabooga) as a back-end and have it run with `--api` to use the front end of my choice.
  • _puk 3y ago
    Not at my computer right now to double check.. but doesn't GPT4All's "Browse" button in the model list let you pick a locally downloaded model?