4 ms·
I will only consider AMD GPUs for LLM when I can easily make my AMD GPU available within WSL and Docker on Windows. For now, it is as if AMD does not exist in
by mrcsharp 2y ago
I will only consider AMD GPUs for LLM when I can easily make my AMD GPU available within WSL and Docker on Windows.
For now, it is as if AMD does not exist in this field for me.
- e-max 2y agoIsn't it already available somehow? I didn't test it seriously, I just needed to quickly run Whisper but $ rocminfo | grep -E "WSL|XTX" WSL environment detected. Marketing Name: AMD Radeon RX 7900 XTX
- mrcsharp 2y agoInteresting. Looking here [1] it seems like this is a thing now. Will dive deeper into this later but looks promising. [1] https://rocm.docs.amd.com/projects/radeon/en/latest/docs/install/wsl/install-radeon.html https://rocm.docs.amd.com/projects/radeon/en/latest/docs/ins...