4 ms·

I haven't been following the market until recently, but isn't the AMD Ryzen Max AI a consumer friendly AI option? Is it just not serious enough relative to the

I haven't been following the market until recently, but isn't the AMD Ryzen Max AI a consumer friendly AI option? Is it just not serious enough relative to the Nvidia offerings?

curt15 1y ago
Does ROCm work on Ryzem Max AI?
- jakogut 1y ago
  It works on the GPU, and the NPU is supposed to work on Windows using a framework called lemonade (I haven't tried), but the NPU is not supported with the same software stack on Linux yet.
- rpdillon 1y ago
  Yes, I have an AMD Ryzen AI Max+ chip with memory set to allocate 96 gigs to the GPU and 32 gigs to the CPU. I got it last week, and I've been running gpt-oss-120b at q5 at 40t/s. I run Linux with llama.cpp compiled against ROCm 7.
  - lostmsu 1y ago
    Did you try the native mxfp4 (obviously, Vulkan/ROCm would have to load and upscale it)?
- fooker 1y ago
  Barely.