3 ms·
Rocm will only get adoption when Cuda code can be ported over with 1 click. At the very least, pytorch has to work effortlessly across GPUs, down to the less p
by screye 3y ago
Rocm will only get adoption when Cuda code can be ported over with 1 click.
At the very least, pytorch has to work effortlessly across GPUs, down to the less popular and odd workarounds people build into their pyotrch code.
Even if RocM reaches parity, the first mover advantage for Cuda is too large. RocM porting has to be literally effortless. Everything else is DOA.
- screye 3y agoEdit- That being said, if you a cloud provider and need to scale up a bunch of basically similar transformers models, then it should be an easy sell for AMD.
- wmf 3y agoThe facts don't bear this out. Various companies have already ported to AMD even though it isn't effortless.
- com2kid 3y agoCounterpoint, at scale a month of training a GPU cost more than an engineer now days. And the large companies (Meta, Microsoft) buy these GPUs by the thousands upon thousands. Having a small team of engineers spend a couple months porting code over is well worth it for even modest cost reductions. These may not be useful to smaller companies working in the AI space, but odds are to sellout, all AMD really needs are the sales contracts that they've already announced.
- Der_Einzige 3y agoPeople here don't want to hear the truth, but this is the truth.