3 ms·
If you have the ram for it. Ollama will offload as many layers as it can to the gpu then the rest will run on the cpu/ram.
by vorticalbox 2y ago
If you have the ram for it.
Ollama will offload as many layers as it can to the gpu then the rest will run on the cpu/ram.