7 ms·

I think this has changed since then, their policies toward open source improved (e.g ROCm).

by da-x 27d ago

dist-epoch 27d ago
The market says the problem is still there. An NVIDIA consumer GPU sells for 50+% or more than an equivalent AMD GPU. Because people are buying NVIDIA GPUs to run local models instead of AMD ones. I did the same thing, I paid 50% more to get an 5070 Ti instead of the equivalent AMD. This is probably good for gamers, AMD GPUs are not price inflating to the same degree as NVIDIA, because they are bad at LLMs. > That was the reason for comparing them in the first place: based on performance, they are direct competitors, or at least they are meant to be. However, as things stand today, there is a massive price divide between the two, with the RTX Ti GPU now commanding a premium of more than 50%. https://www.techspot.com/review/3168-geforce-rtx-5070-vs-radeon-rx-9070-xt/ https://www.techspot.com/review/3168-geforce-rtx-5070-vs-rad...
- sznio 27d ago
  wondering when AMD will realize it can charge 2x as much for the same thing, by simply finally writing a fucking driver
  - prymitive 27d ago
    The story of “great hardware ruined by poor drivers/software” is so old than its truly shocking its still a thing these days
    - esseph 26d ago
      On Linux the problem is often flipped (historically for Nvidia/AMD). The AMD drivers are mainline kernel, while Nvidia is still handing out binary blobs.
  - numpad0 27d ago
    AMD also deprecates cards and throw in wrenches for cards that are hot in used markets. Latest ROCm kind of works on MI50 but requisite files are taken out of just standard Ubuntu installation. They truly don't understand marketing.
    - esseph 26d ago
      That is a ~9 year old card. I'm not sure any of the newer work AMD has been doing can utilize that hardware at all. It would have been sold off to grey market or destroyed 3-4yr ago in most companies. Newer, much cheaper stuff ironically would run better. That card isn't even really designed for AI workloads at all.
- esseph 27d ago
  > AMD GPUs are not price inflating to the same degree as NVIDIA, because they are bad at LLMs. 9060 XT 16GB seems to have some great performance with gpt oss 20B and others, and works great with their lemonade-server. https://lemonade-server.ai/ https://lemonade-server.ai/ What exactly do you think is running on a Strix Halo?
- lrvick 27d ago
  > because they are bad at LLMs. They are actually great at LLMs but you need to invest in keeping up with community tuning efforts. But I am fine with most thinking they are bad at LLMs, because I keep buying more of them!

I think this has changed since then, their policies toward open source improved (e.g ROCm).

by da-x 27d ago

I think this has changed since then, their policies toward open source improved (e.g ROCm).

The market says the problem is still there. An NVIDIA consumer GPU sells for 50+% or more than an equivalent AMD GPU. Because people are buying NVIDIA GPUs to run local models instead of AMD ones. I did the same thing, I paid 50% more to get an 5070 Ti instead of the equivalent AMD. This is probably good for gamers, AMD GPUs are not price inflating to the same degree as NVIDIA, because they are bad at LLMs. > That was the reason for comparing them in the first place: based on performance, they are direct competitors, or at least they are meant to be. However, as things stand today, there is a massive price divide between the two, with the RTX Ti GPU now commanding a premium of more than 50%. https://www.techspot.com/review/3168-geforce-rtx-5070-vs-radeon-rx-9070-xt/ https://www.techspot.com/review/3168-geforce-rtx-5070-vs-rad...

sznio 27d ago
wondering when AMD will realize it can charge 2x as much for the same thing, by simply finally writing a fucking driver
- prymitive 27d ago
  The story of “great hardware ruined by poor drivers/software” is so old than its truly shocking its still a thing these days
  - esseph 26d ago
    On Linux the problem is often flipped (historically for Nvidia/AMD). The AMD drivers are mainline kernel, while Nvidia is still handing out binary blobs.
- numpad0 27d ago
  AMD also deprecates cards and throw in wrenches for cards that are hot in used markets. Latest ROCm kind of works on MI50 but requisite files are taken out of just standard Ubuntu installation. They truly don't understand marketing.
  - esseph 26d ago
    That is a ~9 year old card. I'm not sure any of the newer work AMD has been doing can utilize that hardware at all. It would have been sold off to grey market or destroyed 3-4yr ago in most companies. Newer, much cheaper stuff ironically would run better. That card isn't even really designed for AI workloads at all.
esseph 27d ago
> AMD GPUs are not price inflating to the same degree as NVIDIA, because they are bad at LLMs. 9060 XT 16GB seems to have some great performance with gpt oss 20B and others, and works great with their lemonade-server. https://lemonade-server.ai/ https://lemonade-server.ai/ What exactly do you think is running on a Strix Halo?
lrvick 27d ago
> because they are bad at LLMs. They are actually great at LLMs but you need to invest in keeping up with community tuning efforts. But I am fine with most thinking they are bad at LLMs, because I keep buying more of them!