3 ms·
It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks :D They have shipped ROCm containers since 0.1.27 (21 days
by Zambyte 3y ago
It's pretty funny to see this blog post, when I have been running Ollama on my AMD RX 6650 for weeks :D
They have shipped ROCm containers since 0.1.27 (21 days ago). This blog post seems to be published along with the latest release, 0.1.29. I wonder what they actually changed in this release with regards to AMD support.
Also: see this issue[0] that I made where I worked through running Ollama on an AMD card that they don't "officially" support yet. It's just a matter of setting an environment variable.
[0] https://github.com/ollama/ollama/issues/2870 https://github.com/ollama/ollama/issues/2870
Edit: I did notice one change, now the starcoder2[1] model works now. Before that would crash[2].
[1] https://ollama.com/library/starcoder2 https://ollama.com/library/starcoder2
[2] https://github.com/ollama/ollama/issues/2953 https://github.com/ollama/ollama/issues/2953
- throwaway5959 3y agoI mean, it was 21 days ago. What’s the difference?
- yjftsjthsd-h 3y ago2 versions, apparently
- mchiang 3y agoWhile the PRs went in slightly earlier, much of the time was spent on testing the integrations, and working with AMD directly to resolve issues. There were issues that we resolved prior to cutting the release, and many reported by the community as well.
- Zambyte 3y agoThank you for clarifying and thanks for the great work you do!
- cjbprime 3y agoMaybe they wanted to wait for bug reports for 21 days before publishing a popular blog post about it..?
- layoric 3y agoWhat kind of performance do you see with an RX 6650?