3 ms·
can it run on my macbook air locally yet, with acceptable performance? Guess the answer is still no
by anonyfox 3y ago
can it run on my macbook air locally yet, with acceptable performance? Guess the answer is still no
- fredoliveira 3y agoYou'll be able to use it with llama.cpp soon [1], so, should run fine on your macbook, yes. [1]: https://github.com/ggerganov/llama.cpp/pull/3362#issuecomment-1737745878 https://github.com/ggerganov/llama.cpp/pull/3362#issuecommen...
- anonyfox 3y agothat really was "soon", wow - already pulling it with ollama!