3 ms·
When I can run Ollama with my favorite five models on my Clockwork uConsole with a 12 hour battery life … The future will have arrived!
by heckraiser 3y ago
When I can run Ollama with my favorite five models on my Clockwork uConsole with a 12 hour battery life …
The future will have arrived!
- mark_l_watson 3y agoWell, we are not there yet! I can run my own mixtral:8x7b-instruct-v0.1-q2 RAG applications on my $1900 Mac Mini, and I now use Ollama for almost all local models. Cory was not totally negative about AI in this article, but I would have also liked to hear his take on open LLMs.