2 ms·
Wouldn't expect that to work at all.
by cjbprime 3y ago
Wouldn't expect that to work at all.
- hedgehog 3y agoOllama (which wraps llama.cpp) supports splitting a model across devices so you get some acceleration even on models too big to fit entirely in GPU memory.