5 ms·
I've concluded they're just allergic to money. Even after it became very clear that this is going to be big they're still slow off the block as if they're not
by Havoc 3y ago
I've concluded they're just allergic to money.
Even after it became very clear that this is going to be big they're still slow off the block as if they're not even trying.
e.g. Why not make a list of the top 500 people in AI field and send them cards no strings attached plus as good of low level documentation as you can muster. Insignificant cost to AMD but could move the mindshare needle if even 20 of the 500 experiment and make some noise about it in their circles.
The Icewhale guys did exactly that best as I can tell. 350k USD hardware kickstarter so really lean. Yet all the youtubers even vaguely in their niche seem to have one of their boards. It's a good board don't get me wrong, but there is no way that was organic. Some sharp marketeer made sure the right people have the gear to influence mindshare.
https://www.youtube.com/results?search_query=zimaboard https://www.youtube.com/results?search_query=zimaboard
- jjoonathan 3y agoMy suspicion is that the GPGPU hardware in shipped cards has known problems / severe limitations due to neglect of that side of the architecture for the last ~10 years. Shipping a bunch of cards only to burn the next generation of AMD compute fans as badly as they burned the last generation of AMD compute fans would not be wise. It's painful to wait, but it may well be for the best.
- gdiamos 3y agoInstinct has much better SW support today than Radeon, so you would need to send MI210s/etc . I think it's at the point where if you are comfortable with GEMM kernels, setting up SLURM, etc it is usable. But if you want to stay at the huggingface layer or higher, you will run into issues. Many AI researchers are higher level than that these days, but some are still of us willing to go lower level.
- spacecadet 3y agoYeah, this. I tried to do some computing with AMD server grade cards 2 years ago and found all of the API so out of fate and the documentation equally out of date... Went CUDA and didnt look back. Sad, cause Im an AMD fanboy of old.
- tysam_and 3y agoIt seems like Hotz and co are able to move pretty well on it, so maybe there's some low-level stuff they're using (or maybe they're forced to for a few reasons) w.r.t. the tinybox, but it is impressive how much they've been able to do so far I think. :3 <3 :')))) :')
- simfree 3y agoThe Radeon MI series seems to perform fine if you follow their software stack happy path. Same for using modified versions of ROCm on APUs, it's just no one has been willing to invest in paying a few developers to work on broader hardware support full-time, thus any bugs outside enterprise Linux distros on Radeon MI series cards do not get triaged.
- freeone3000 3y agoROCm on Vega only works on certain motherboards because the card lacks a synchronization clock over the PCI bus. They added it on some later cards. It’s absurd how much is lacking and inconsistent.
- treprinum 3y agoI suspect it's because they don't want to pay for software engineers as hardware engineers are much cheaper. I was contacted by their recruiter last year and it turned out the principal engineer salary was at the level of entry FAANG salary, so I suspect they can't really source the best people.
- bitcoinmoney 3y agoHow much was the salary for principal? Because I know it can do 400k TC and not sure entry level FAANG is that level.
- roenxi 3y ago> e.g. Why not... A key part of progress is choosing the direction to progress in. Flashy knee-jerk moves like that sound good but it isn't the fastest way to move forward. The first step (which I think they've taken) is for the executives to align on what the market wants. The second is to work out how to achieve it, the third to do it. Handing out freebies would probably help, but it'll take sustained long term strategy for AMD to make money. AMD's problem isn't low-level developer interest. The George Hotz video rant on AMD was enlightening - the interest is there and the official drivers just don't work. A few years ago I made an effort to get in to reinforcement learning as a hobby and was blocked by AMD crashes. At the time I assumed I'd done something wrong. I still believe that, but I'm less certain now. It is possible that the reason AMD is doing so poorly is just that their code to do BLAS is buggy. People get very excited about CUDA and maybe everything there is necessary, but on AMD the problem seems to be that the card can't reliably multiply matrices together. I got some early nights using Stable Diffusion because everything worked great for an hour then the kernel paniced. I didn't give AMD any feedback because I run an unsupported card and OS - effectively all cards and OSs are unsupported - but if that is widespread behaviour it would be a grave blocker. I think they are serious now though. The ROCM documentation dropped a lot of infuriating corporate waffle recently and that is a sign that good people are involved. Still going to wait and see before getting too hopeful that it works out well.
- jacquesm 3y ago> Flashy knee-jerk moves like that sound good but it isn't the fastest way to move forward. NVidia: - Games -> we're on it - Machine learning -> we're on it - Crypto -> we're on it - LLM / AI -> we're on it Compare the growth rate of NVidia vs AMD and you get the picture. Flashy knee-jerk moves are bad, identifying growth segments in your industry and running with them is excellent strategy. People get excited about CUDA because it works, and AMD could have had a very large slice of that pie. > on AMD the problem seems to be that the card can't reliably multiply matrices together. I got some early nights using Stable Diffusion because everything worked great for an hour then the kernel paniced. I didn't give AMD any feedback because I run an unsupported card and OS - effectively all cards and OSs are unsupported - but if that is widespread behaviour[sic] it would be a grave blocker. Exactly. And with NVIDIA you'd be working on your problem instead. And that's what makes the difference. AMD should do exactly what the OP wrote: gain mindshare by getting at least some researchers on board with their product, assuming they haven't burned their brand completely by now.
- deleted 3y ago[deleted]