2 ms·

It's not my job to reformat the entire AI market. I'm willing to try AMD, and I even built an AMD-based machine to experiment with AI workflows. So far it has

It's not my job to reformat the entire AI market. I'm willing to try AMD, and I even built an AMD-based machine to experiment with AI workflows. So far it has been failing miserably. I don't care that MI300X is compelling when I can't make samples work both on my desktop and on a cloud-based MI300X. I don't care about their academic collaborations, I'm not in the business of producing papers. I'll just pay for H100 in the cloud to be sure that I will be able to run the resulting models on my 3090 locally and/or deploy to 4090 clusters. If AMD shows some sense, commits to long-term support for their hardware with reasonable feature-parity across multiple generations, I'll reconsider them. And AMD has a history of doing that! Their CPU division is _excellent_, they are renowned for having long-term support for motherboard socket types. I remember being able to buy a motherboard and then not worrying about upgrading the CPU for the next 3-4 years.

latchkey 2y ago
> I'm willing to try AMD, and I even built an AMD-based machine to experiment with AI workflows. So far it has been failing miserably. I don't care that MI300X is compelling when I can't make samples work both on my desktop and on a cloud-based MI300X. Anush was actively looking for feedback on this on github today... https://www.reddit.com/r/ROCm/comments/1i5aatx/rocm_feedback_for_amd/ https://www.reddit.com/r/ROCm/comments/1i5aatx/rocm_feedback... https://github.com/ROCm/ROCm/discussions/4276 https://github.com/ROCm/ROCm/discussions/4276
- magic_at_nodai 2y ago
  I have quad w7900s under my desk that work well for workloads on my desktop that translate well to MI300x. There are some perf gaps with FAv2, and FP8 but otherwise I get a seamless experience. lmk if you have a pointer to any github issues for me to track down to make your experience better.
  - saagarjha 2y ago
    Do you not have (remote) access to a MI300X?

latchkey 2y ago

> I'm willing to try AMD, and I even built an AMD-based machine to experiment with AI workflows. So far it has been failing miserably. I don't care that MI300X is compelling when I can't make samples work both on my desktop and on a cloud-based MI300X. Anush was actively looking for feedback on this on github today... https://www.reddit.com/r/ROCm/comments/1i5aatx/rocm_feedback_for_amd/ https://www.reddit.com/r/ROCm/comments/1i5aatx/rocm_feedback... https://github.com/ROCm/ROCm/discussions/4276 https://github.com/ROCm/ROCm/discussions/4276

magic_at_nodai 2y ago
I have quad w7900s under my desk that work well for workloads on my desktop that translate well to MI300x. There are some perf gaps with FAv2, and FP8 but otherwise I get a seamless experience. lmk if you have a pointer to any github issues for me to track down to make your experience better.
- saagarjha 2y ago
  Do you not have (remote) access to a MI300X?