3 ms·
have you tested llama.cpp with this card on Linux? when i tested about a year ago, it was a nightmare.
by khimaros 2y ago
have you tested llama.cpp with this card on Linux? when i tested about a year ago, it was a nightmare.
- mtlmtlmtlmtl 2y agoA few months ago, yeah. Had to set an environment variable(added to the ollama systemd unit file), but otherwise it worked just fine.