Software over there seems like it must be a total mess. There is a pretty good sized market for people training DL models that Nvidia currently owns completely

Software over there seems like it must be a total mess. There is a pretty good sized market for people training DL models that Nvidia currently owns completely that they have not yet entered simply because they haven't made Tensorflow and Pytorch work with ROCm. Even the ROCm web pages are amateurish and appear to have virtually no work behind them. Seriously, it's three very good developers and a few months of work that's holding them back from maybe a hundred million in sales, and at least 20 billion in their stock valuation from being perceived as being in the DL game.