4 ms·
I can run the 8B with my M2 Pro Mac mini with 32GB via Ollama. It takes around one second to get a response from the API.
by mertbio 2y ago
I can run the 8B with my M2 Pro Mac mini with 32GB via Ollama. It takes around one second to get a response from the API.