4 ms·
I tried that, but failed to get the GPU split working. Do you have a link on how to do that?
by _ink_ 3y ago
I tried that, but failed to get the GPU split working. Do you have a link on how to do that?
- lxe 3y agoDo what exactly? I have no issues with GPU split on oobabooga with either exl2 or gguf.