4 ms·
AMD GPU support is definitely an important part of the project roadmap (sorry this isn't better published in a ROADMAP.md or similar for the project – will do t
by jmorgan 3y ago
AMD GPU support is definitely an important part of the project roadmap (sorry this isn't better published in a ROADMAP.md or similar for the project – will do that soon).
A few of the maintainers of the project are from the Toronto area, the original home of ATI technologies [1], and so we personally want to see Ollama work well on AMD GPUs :).
One of the test machines we use to work on AMD support for Ollama is running a Radeon RX 7900XT, and it's quite fast. Definitely comparable to a high-end GeForce 40 series GPU.
[1]: https://en.wikipedia.org/wiki/ATI_Technologies https://en.wikipedia.org/wiki/ATI_Technologies
- FirmwareBurner 3y agoWhat about AMD APUs with RDNA graphics? ANy chance of getting Olama for them?
- spookie 3y agoI suppose it comes down to ROCm support. https://docs.amd.com/en/docs-5.7.1/release/windows_support.html https://docs.amd.com/en/docs-5.7.1/release/windows_support.h...