4 ms·

> the AMD ecosystem for that is absolute trash > there are zero reliable and detailed public benchmarks on MI300x I not very familiar with the space, but as a

> the AMD ecosystem for that is absolute trash > there are zero reliable and detailed public benchmarks on MI300x I not very familiar with the space, but as an outsider looking in your datapoint appears to support the parent poster's opinion that the space is not mature. Wouldn't a complete lack of public benchmarks suggest that the ecosystem just isn't there yet?

latchkey 2y ago
They didn't say it wasn't mature, they said it is absolute trash. My point is to agree that it isn't mature. Why isn't it mature? Well... nobody has access to these things. Today, they are only available behind HPC / hyperscaler walls. In order to gain some maturity, someone needs to offer them out in the wild. That's where I come in.
- dumpsterdiver 2y ago
  Fair enough.
- humansareok1 2y ago
  I challenge you to try to get it working and train a basic LLM yourself on multiple AMD gpus. It is far worse than the situation with Nvidia GPUs/Drivers and Linux circa the mid 2010s. Which is saying a lot... But don't take my word for it. Geohot, maybe one of the best hackers of our generation can't even it working: https://wccftech.com/tinycorp-ditches-amd-tinybox-ai-package-opt-for-nvidia-or-intel-options/ https://wccftech.com/tinycorp-ditches-amd-tinybox-ai-package... It IS trash and it's clearly NOT mature. These are not mutually exclusive. There have been attempts to get AMD to open source their firmware to let people work on it since they themselves seem disinterested in doing so. Until then AMD is not a real choice for serious ML work.
  - latchkey 2y ago
    Quoting George is a bad look and instantly discredits you as a parrot. Did you know... George has never used a MI300x and refused my multiple offers to let him try mine, calling me an "AMD shill." If you know me personally, that is hilariously the furthest thing from the truth one can get. Again, before you can challenge me, I have already challenged you to back up your claim that "it is trash." Quoting George certainly is not that.

latchkey 2y ago

They didn't say it wasn't mature, they said it is absolute trash. My point is to agree that it isn't mature. Why isn't it mature? Well... nobody has access to these things. Today, they are only available behind HPC / hyperscaler walls. In order to gain some maturity, someone needs to offer them out in the wild. That's where I come in.

dumpsterdiver 2y ago
Fair enough.
humansareok1 2y ago
I challenge you to try to get it working and train a basic LLM yourself on multiple AMD gpus. It is far worse than the situation with Nvidia GPUs/Drivers and Linux circa the mid 2010s. Which is saying a lot... But don't take my word for it. Geohot, maybe one of the best hackers of our generation can't even it working: https://wccftech.com/tinycorp-ditches-amd-tinybox-ai-package-opt-for-nvidia-or-intel-options/ https://wccftech.com/tinycorp-ditches-amd-tinybox-ai-package... It IS trash and it's clearly NOT mature. These are not mutually exclusive. There have been attempts to get AMD to open source their firmware to let people work on it since they themselves seem disinterested in doing so. Until then AMD is not a real choice for serious ML work.
- latchkey 2y ago
  Quoting George is a bad look and instantly discredits you as a parrot. Did you know... George has never used a MI300x and refused my multiple offers to let him try mine, calling me an "AMD shill." If you know me personally, that is hilariously the furthest thing from the truth one can get. Again, before you can challenge me, I have already challenged you to back up your claim that "it is trash." Quoting George certainly is not that.