5 ms·
Silly question: I'm thinking of dipping my toes into local LLM. Let's say I point my resources at getting one up and running that outputs tokens in an acceptab
by andrewinardeer 3y ago
Silly question: I'm thinking of dipping my toes into local LLM.
Let's say I point my resources at getting one up and running that outputs tokens in an acceptable manner - then what? What can I do with a local LLM?
- prepend 3y agoAside from not needing connectivity, the main thing I think, you can ask it anything that ChatGPT wouldn’t answer (eg, politics, health topics, etc).
- runjake 3y ago- Run different models[1]. Some models specialize in different tasks, some are uncensored. - Be able to access your local LLM without an Internet connection. - Feed it custom data and prompt sets for GPTs-like functionality without paying OpenAI $20/month. I mostly use Ollama, so I set these up with Modelfiles[2]. Other products have similar solutions. 1. https://huggingface.co/models https://huggingface.co/models 2. https://github.com/jmorganca/ollama#customize-your-own-model https://github.com/jmorganca/ollama#customize-your-own-model