3 ms·

My suspicion is that the GPGPU hardware in shipped cards has known problems / severe limitations due to neglect of that side of the architecture for the last ~1

My suspicion is that the GPGPU hardware in shipped cards has known problems / severe limitations due to neglect of that side of the architecture for the last ~10 years. Shipping a bunch of cards only to burn the next generation of AMD compute fans as badly as they burned the last generation of AMD compute fans would not be wise. It's painful to wait, but it may well be for the best.

gdiamos 3y ago
Instinct has much better SW support today than Radeon, so you would need to send MI210s/etc . I think it's at the point where if you are comfortable with GEMM kernels, setting up SLURM, etc it is usable. But if you want to stay at the huggingface layer or higher, you will run into issues. Many AI researchers are higher level than that these days, but some are still of us willing to go lower level.
spacecadet 3y ago
Yeah, this. I tried to do some computing with AMD server grade cards 2 years ago and found all of the API so out of fate and the documentation equally out of date... Went CUDA and didnt look back. Sad, cause Im an AMD fanboy of old.
tysam_and 3y ago
It seems like Hotz and co are able to move pretty well on it, so maybe there's some low-level stuff they're using (or maybe they're forced to for a few reasons) w.r.t. the tinybox, but it is impressive how much they've been able to do so far I think. :3 <3 :')))) :')
simfree 3y ago
The Radeon MI series seems to perform fine if you follow their software stack happy path. Same for using modified versions of ROCm on APUs, it's just no one has been willing to invest in paying a few developers to work on broader hardware support full-time, thus any bugs outside enterprise Linux distros on Radeon MI series cards do not get triaged.
freeone3000 3y ago
ROCm on Vega only works on certain motherboards because the card lacks a synchronization clock over the PCI bus. They added it on some later cards. It’s absurd how much is lacking and inconsistent.

gdiamos 3y ago

Instinct has much better SW support today than Radeon, so you would need to send MI210s/etc . I think it's at the point where if you are comfortable with GEMM kernels, setting up SLURM, etc it is usable. But if you want to stay at the huggingface layer or higher, you will run into issues. Many AI researchers are higher level than that these days, but some are still of us willing to go lower level.

spacecadet 3y ago

Yeah, this. I tried to do some computing with AMD server grade cards 2 years ago and found all of the API so out of fate and the documentation equally out of date... Went CUDA and didnt look back. Sad, cause Im an AMD fanboy of old.

tysam_and 3y ago

It seems like Hotz and co are able to move pretty well on it, so maybe there's some low-level stuff they're using (or maybe they're forced to for a few reasons) w.r.t. the tinybox, but it is impressive how much they've been able to do so far I think. :3 <3 :')))) :')

simfree 3y ago

The Radeon MI series seems to perform fine if you follow their software stack happy path. Same for using modified versions of ROCm on APUs, it's just no one has been willing to invest in paying a few developers to work on broader hardware support full-time, thus any bugs outside enterprise Linux distros on Radeon MI series cards do not get triaged.

freeone3000 3y ago

ROCm on Vega only works on certain motherboards because the card lacks a synchronization clock over the PCI bus. They added it on some later cards. It’s absurd how much is lacking and inconsistent.