3 ms·

People are doubtful of this because AMD has halfassed it over and over in the past, but I do see a lot of desire among MS, google, and AMZ to break nvidia's mon

People are doubtful of this because AMD has halfassed it over and over in the past, but I do see a lot of desire among MS, google, and AMZ to break nvidia's monopoly on gpu compute. I don't know that ROCm will be the thing that does that but I do think some open source alternative will gain steam. Google is furthest along here with their tensor cores and the support for that, but I could easily see a group rallying behind AMD hardware as the only gpu manufacturer out there that has serious experience with HPC.

DesiLurker 3y ago
The way I see it is its now or never for AMD. with the amount of money pouring into AI & gpgpu compute if AMD cant even get it right now then they will never be able to do it as nvidia pulls away further and further away. its a shame because their gpus were actually better for this type of compute beginning with bitcoin mining but for some reason they never foresaw this even though nvidia has been investing steadily in CUDA for about a decade.
belval 3y ago
> do see a lot of desire among MS, google, and AMZ to break nvidia's monopoly on gpu compute They are all implementing XLA-compatible accelerators where the software is mostly opensource and the hardware is not. > but I could easily see a group rallying behind AMD hardware I strongly believe that ship has sailed and sunk to the bottom of the ocean. MS/Meta/Google/Amazon won't hitch their trailer to another platform that they don't control. They will invest more and more into custom silicon which offers one more way to do vendor lock-in while also giving them more control over pricing strategies. Right now the issue is that they can't buy enough Nvidia GPUs to meet demand and Nvidia is itself forced to deal with TSMC.
pjmlp 3y ago
Microsoft has enough compute via DirectX. Any viable alternative to CUDA itself, must be at the same level in tooling, libraries and polyglot capabilities.

DesiLurker 3y ago

The way I see it is its now or never for AMD. with the amount of money pouring into AI & gpgpu compute if AMD cant even get it right now then they will never be able to do it as nvidia pulls away further and further away. its a shame because their gpus were actually better for this type of compute beginning with bitcoin mining but for some reason they never foresaw this even though nvidia has been investing steadily in CUDA for about a decade.

belval 3y ago

> do see a lot of desire among MS, google, and AMZ to break nvidia's monopoly on gpu compute They are all implementing XLA-compatible accelerators where the software is mostly opensource and the hardware is not. > but I could easily see a group rallying behind AMD hardware I strongly believe that ship has sailed and sunk to the bottom of the ocean. MS/Meta/Google/Amazon won't hitch their trailer to another platform that they don't control. They will invest more and more into custom silicon which offers one more way to do vendor lock-in while also giving them more control over pricing strategies. Right now the issue is that they can't buy enough Nvidia GPUs to meet demand and Nvidia is itself forced to deal with TSMC.

pjmlp 3y ago

Microsoft has enough compute via DirectX. Any viable alternative to CUDA itself, must be at the same level in tooling, libraries and polyglot capabilities.