3 ms·

16GB for $330. The price is about the same as an Arc A770 16GB, and about 66% of a 4060 Ti 16GB. That's potentially compelling. I'd love to see benchmarks and

by blagie 3y ago

16GB for $330. The price is about the same as an Arc A770 16GB, and about 66% of a 4060 Ti 16GB. That's potentially compelling. I'd love to see benchmarks and compatibility for PyTorch, llama, Stable Diffusion, etc. I assume it's still a train wreck, but if AMD can get it's software stack in shape, that'd be very, very competitive.

bavell 3y ago
I've had very little issues (other than not amazing perf) with my last-gen 6750XT running llamacpp and SD for the last 8-10 months.
FuriouslyAdrift 3y ago
For stable diffusion, I have found the DirectML fork works great (https://community.amd.com/t5/ai/how-to-automatic1111-stable-diffusion-webui-with-directml/ba-p/649027 https://community.amd.com/t5/ai/how-to-automatic1111-stable-...) Needs a few start arguments (--lowvram --precision full --no-half --skip-torch-cuda-test). YMMV. GPT4All also works well for LLML on AMD.
- tharmas 3y ago
  Many thanks for the reference to GPT4All. I wasn't aware of it before.
- blagie 3y ago
  Kind of. Here's the basic problem: 1) The BIG tools have SOME port to AMD. I am confident that one can run Mistral or SD in some framework there. 2) It's a port. If you want to do anything bleeding edge, development, niche, or similar, it's a dumpster fire. I do dome amount of development which uses LLMs. I want to be able to use a model directly from Hugging Face and have it just work.
  - FuriouslyAdrift 3y ago
    Only reason I am using the DirectML fork of Automatic1111 is because I am on Windows and pytorch hasn't caught up to RocM 6. DirectML is fully supported path on Windows and is support by Microsoft et al. (https://github.com/microsoft/DirectML https://github.com/microsoft/DirectML). Everyone is moving off Cuda as quickly as possible not because the other are better, per se, but because it is easier and cheaper.
LooseMarmoset 3y ago
a limited anecdote for you: I played a lot of War Thunder on Devuan (Debian minus systemd) through Steam. Up till last year, I owned an nVidia 1080Ti. Performance in Linux was quite good, but I had crash after crash in War Thunder - Gaijin blamed nVidia for the bug, nVidia blamed Gaijin. End result was it remains crashy. Closed-source, so nobody who really cares can look. The crashes were so frustrating I decided to go AMD. nVidia driver updates are sometimes a crapshoot, most times it works fine, but every now and again the update results in a broken Xorg which is a PITA to fix, heaven help you if you get a mix of the nouveau and the official drivers. Last year, I bought an AMD 6700XT as the prices dropped. I chose the 6700XT as it seemed like the best performance at the lowest power/cooling requirement. Gaming has been flawless with just the in-kernel drivers using RADV. No addon software stack required, "it just works". I play a lot of games using Proton/Steam, so if issues were going to pop up, it would be there. I had some initial confusion as I thought I'd need to download the drivers from AMD, but as it turns out everything works great in kernel 6.x automatically provided you have the non-free firmware packages installed.
- westpfelia 3y ago
  Was there anything you did to help run the game after the switch? I have a 7900 xtx and WT crashes after each match :/ I am running Fedora w/ Wayland.
  - LooseMarmoset 3y ago
    I'm not running Wayland, so I can't answer questions on that. Also, you have the 7900, and I imagine the drivers for that are pretty new. You'll want a fairly recent kernel (6.1+) You might want to look for updated AMD firmware on kernel.org - do a "grep -i firmware /var/log/messages" or syslog or whatever Fedora is using now. The output of "dmesg" probably also contains some clues. feel free to post back here if you find stuff.

by blagie 3y ago

bavell 3y ago

I've had very little issues (other than not amazing perf) with my last-gen 6750XT running llamacpp and SD for the last 8-10 months.

FuriouslyAdrift 3y ago

For stable diffusion, I have found the DirectML fork works great (https://community.amd.com/t5/ai/how-to-automatic1111-stable-diffusion-webui-with-directml/ba-p/649027 https://community.amd.com/t5/ai/how-to-automatic1111-stable-...) Needs a few start arguments (--lowvram --precision full --no-half --skip-torch-cuda-test). YMMV. GPT4All also works well for LLML on AMD.

tharmas 3y ago
Many thanks for the reference to GPT4All. I wasn't aware of it before.
blagie 3y ago
Kind of. Here's the basic problem: 1) The BIG tools have SOME port to AMD. I am confident that one can run Mistral or SD in some framework there. 2) It's a port. If you want to do anything bleeding edge, development, niche, or similar, it's a dumpster fire. I do dome amount of development which uses LLMs. I want to be able to use a model directly from Hugging Face and have it just work.
- FuriouslyAdrift 3y ago
  Only reason I am using the DirectML fork of Automatic1111 is because I am on Windows and pytorch hasn't caught up to RocM 6. DirectML is fully supported path on Windows and is support by Microsoft et al. (https://github.com/microsoft/DirectML https://github.com/microsoft/DirectML). Everyone is moving off Cuda as quickly as possible not because the other are better, per se, but because it is easier and cheaper.

LooseMarmoset 3y ago

a limited anecdote for you: I played a lot of War Thunder on Devuan (Debian minus systemd) through Steam. Up till last year, I owned an nVidia 1080Ti. Performance in Linux was quite good, but I had crash after crash in War Thunder - Gaijin blamed nVidia for the bug, nVidia blamed Gaijin. End result was it remains crashy. Closed-source, so nobody who really cares can look. The crashes were so frustrating I decided to go AMD. nVidia driver updates are sometimes a crapshoot, most times it works fine, but every now and again the update results in a broken Xorg which is a PITA to fix, heaven help you if you get a mix of the nouveau and the official drivers. Last year, I bought an AMD 6700XT as the prices dropped. I chose the 6700XT as it seemed like the best performance at the lowest power/cooling requirement. Gaming has been flawless with just the in-kernel drivers using RADV. No addon software stack required, "it just works". I play a lot of games using Proton/Steam, so if issues were going to pop up, it would be there. I had some initial confusion as I thought I'd need to download the drivers from AMD, but as it turns out everything works great in kernel 6.x automatically provided you have the non-free firmware packages installed.

westpfelia 3y ago
Was there anything you did to help run the game after the switch? I have a 7900 xtx and WT crashes after each match :/ I am running Fedora w/ Wayland.
- LooseMarmoset 3y ago
  I'm not running Wayland, so I can't answer questions on that. Also, you have the 7900, and I imagine the drivers for that are pretty new. You'll want a fairly recent kernel (6.1+) You might want to look for updated AMD firmware on kernel.org - do a "grep -i firmware /var/log/messages" or syslog or whatever Fedora is using now. The output of "dmesg" probably also contains some clues. feel free to post back here if you find stuff.