3 ms·
> The rants weren’t breaking news to anyone who was familiar with PyTorch or adjacent communities. How many people in the PyTorch and adjacent communities are
by roenxi 1y ago
> The rants weren’t breaking news to anyone who was familiar with PyTorch or adjacent communities.
How many people in the PyTorch and adjacent communities are trying to port the stack to AMD cards? I'd guess less than 100. That is a pretty small community. They don't do that much in the way of publicity (and, case in point, George does and he attracts a certain number of haters).
George is probably the first public reference I saw who wasn't pointing at CUDA as the problem but tagging kernel & hardware bugs on AMD cards as the blocker. Those are really different things; CUDA isn't that complicated to implement as a half-baked thing. I can implement naive matrix multiplication if I need to and it'd be a fun month of reading academic papers to learn better techniques. But that does nothing to work around hardware and firmware bugs which are an order of magnitude harder to deal with and not something I want to deal with.
I'm happy to buy in to bad software libraries. I don't want a bar of hardware bugs.
- saagarjha 1y agoA lot of the people have been specifically not working on it because they felt that it was not a good use of their time.