3 ms·
I wonder what performance remains on 12GB VRAM GPU when local ollama ties in the systems RAM to run this huge nano model. https://github.com/jameschrisa/Ollama
by barrystaes 10mo ago
I wonder what performance remains on 12GB VRAM GPU when local ollama ties in the systems RAM to run this huge nano model.
https://github.com/jameschrisa/Ollama_Tuning_Guide/blob/main/docs/ram-management.md https://github.com/jameschrisa/Ollama_Tuning_Guide/blob/main...