3 ms·
The tokens per seconds are not great and fans can start to run (I have a M1 Max 64gb and tried 32b on ollama, then went down to 14b for speed)
by khurs 1y ago
The tokens per seconds are not great and fans can start to run (I have a M1 Max 64gb and tried 32b on ollama, then went down to 14b for speed)