3 ms·
And with HIP now supporting Windows[0] it could be a game changer. I would love to see it working with llama.cpp[1]. I tried HIP via Blender, but it did not wor
by Kelteseth 3y ago
And with HIP now supporting Windows[0] it could be a game changer. I would love to see it working with llama.cpp[1]. I tried HIP via Blender, but it did not work for my 6600XT, it still used my CPU...
[0] https://github.com/RadeonOpenCompute/ROCm/issues/666#issuecomment-1655470437 https://github.com/RadeonOpenCompute/ROCm/issues/666#issueco...
[1] https://github.com/ggerganov/llama.cpp/discussions/915#discussioncomment-6626936 https://github.com/ggerganov/llama.cpp/discussions/915#discu...