3 ms·

I tried running the 8B model on my 8GB M2 Macbook Air through Ollama and it was awful. It took ages to do anything and the responses were bad at best.

• redman25 2y ago
  Doesn't 8B need at least 16gb of ram? Otherwise, your swapping I would imagine...
  • blebo 2y ago
    Depends on quantization selected - see https://www.canirunthisllm.net/ https://www.canirunthisllm.net/