3 ms·
Llama.cpp runs mostly on CPU. I say "mostly" because it's possible to compile it with cublas to use GPU for some of the computations. My 2060 Ti 12GB is usably
by sp332 3y ago
Llama.cpp runs mostly on CPU. I say "mostly" because it's possible to compile it with cublas to use GPU for some of the computations.
My 2060 Ti 12GB is usably fast for SD, so I’m guessing these will work great.
- sp332 3y agoActually it's only a 2060 12GB, not even a Ti.