2 ms·
You are running the wrong model. Get a smaller one Macs are usually ok with their performance since the GPU has access to main memory. A decent Nvidia GPU with
by raxxorraxor 3y ago
You are running the wrong model. Get a smaller one
Macs are usually ok with their performance since the GPU has access to main memory. A decent Nvidia GPU with lots of memory is still king though.
I run codelama:7b on a MacBook air, and even auto complete is partially usable.