5 ms·
> and now for LLM I find them at reddit. tons of folks are running huge models Very interesting. Any subs or threads you could recommend/link to? Thanks
by nico 1y ago
> and now for LLM I find them at reddit. tons of folks are running huge models
Very interesting. Any subs or threads you could recommend/link to?
Thanks
- ActorNightly 1y agoBasically just run ollama and run the quantized models. Don't expect high generation speeds though.
- segmondy 1y agojoin us at r/LocalLlama