3 ms·

Some of us have been complaining for close to a decade and there's been multiple promises that have gone no where. It's better to keep complaining until the pro

Some of us have been complaining for close to a decade and there's been multiple promises that have gone no where. It's better to keep complaining until the problem is actually fixed. CUDA is 16 years old and AMD has been "aware" of the issue for at least 10.

latchkey 3y ago
How could they promise to fix something that didn't exist 10-16 years ago? In my eyes, the incentives weren't there before. But, they sure are now!
- ihattendorf 3y ago
  And nvidia is killing it right now because they predicted the need _before_ the incentives were there.
  - latchkey 3y ago
    Nobody is arguing that AMD didn't get caught with their pants around their ankles or that they have a great reputation with developers. What matters is their statements and more importantly, actions, moving forward. Right now, they are cranking out ROCm releases on schedule, contributing to a bunch of AI open source projects, listening to crazy people like George Hotz and have released a GPU product that leapfrogs the H100 and is built on OAM-UBB, at 1/3 the FLOPS/$, while also promoting fast ethernet standards. I'd call that a pretty good start.
- nemothekid 3y ago
  OpenCL did exist 10 years ago! Rocm has been around for 7 years. Pytorch is 7 years old and had CUDA support on day one and still doesn't have RocM support. Before the LLM craze people still wanted an alternative to nvidia and could see the writing on the wall. There was a bunch of complaining about Rocm and OpenCL didn't deliver. GeoHotz tried to get a RocM backend working and the examples just didn't work. You can't build a software platform by just willing it into existence. It means sitting down with developers, writing documentation and support users. It means tackling use cases other than llama so that users feel confident in building the next greatest thing on your platform. At it is today, AMD will always be playing catch up and people will continue to push nvidia because the latest and greatest will be on Cuda. I guess for those of spending money on real gpus for the last 10 years, nvidia was incentivized to take our money but amd wasn't.
  - latchkey 3y ago
    Before the current crazy of AI, what else generated large sums of money for GPUs? Games, rendering and crypto. If I was a hardware company, that's all that I would have focused on. Certainly AMD could have done better on the software/developer front, nobody is arguing that. I tend to live in the present and what matters is what they are saying and doing today. You can choose to be pissed off about the past, or you can work towards the future.

latchkey 3y ago

How could they promise to fix something that didn't exist 10-16 years ago? In my eyes, the incentives weren't there before. But, they sure are now!

ihattendorf 3y ago
And nvidia is killing it right now because they predicted the need _before_ the incentives were there.
- latchkey 3y ago
  Nobody is arguing that AMD didn't get caught with their pants around their ankles or that they have a great reputation with developers. What matters is their statements and more importantly, actions, moving forward. Right now, they are cranking out ROCm releases on schedule, contributing to a bunch of AI open source projects, listening to crazy people like George Hotz and have released a GPU product that leapfrogs the H100 and is built on OAM-UBB, at 1/3 the FLOPS/$, while also promoting fast ethernet standards. I'd call that a pretty good start.
nemothekid 3y ago
OpenCL did exist 10 years ago! Rocm has been around for 7 years. Pytorch is 7 years old and had CUDA support on day one and still doesn't have RocM support. Before the LLM craze people still wanted an alternative to nvidia and could see the writing on the wall. There was a bunch of complaining about Rocm and OpenCL didn't deliver. GeoHotz tried to get a RocM backend working and the examples just didn't work. You can't build a software platform by just willing it into existence. It means sitting down with developers, writing documentation and support users. It means tackling use cases other than llama so that users feel confident in building the next greatest thing on your platform. At it is today, AMD will always be playing catch up and people will continue to push nvidia because the latest and greatest will be on Cuda. I guess for those of spending money on real gpus for the last 10 years, nvidia was incentivized to take our money but amd wasn't.
- latchkey 3y ago
  Before the current crazy of AI, what else generated large sums of money for GPUs? Games, rendering and crypto. If I was a hardware company, that's all that I would have focused on. Certainly AMD could have done better on the software/developer front, nobody is arguing that. I tend to live in the present and what matters is what they are saying and doing today. You can choose to be pissed off about the past, or you can work towards the future.