3 ms·
If I have a dedicated GPU with 12GB of VRAM and 32 GB of system ram, can I combine the two for LLMs. So far ollama will use the 12GB and then give up
by 999900000999 7mo ago
If I have a dedicated GPU with 12GB of VRAM and 32 GB of system ram, can I combine the two for LLMs.
So far ollama will use the 12GB and then give up
- ranger_danger 7mo agollama.cpp can do exactly that