Yep, this thread has a good compilation of ROCm woes: https://news.ycombinator.com/item?id=34832660 https://news.ycombinator.com/item?id=34832660 That said, fo

Yep, this thread has a good compilation of ROCm woes: https://news.ycombinator.com/item?id=34832660 https://news.ycombinator.com/item?id=34832660 That said, for hobbyist inference on large pretrained models, I think there is an interesting set of possibilities here: maybe a number of operations aren't optimized, and it takes 10x as long to load the model into memory... but all that might not matter if AMD were to be the first to market for 128GB+ VRAM cards that are the only things that can run next-generation open-weight models in a desktop environment, particularly those generating video and images. The hobbyists don't need to optimize all the linear algebra operations that researchers need to be able to experiment with when training; they just need to implement the ones used by the open-weight models. But of course this is all just wishful thinking, because as others have pointed out, any developments in this direction would require a level of foresight that AMD simply hasn't historically shown.