Nice work! I was just playing with the inference side of things with 405B myself this weekend [0]. I'm not convinced that 'torch.cuda' is really that bad since

Nice work! I was just playing with the inference side of things with 405B myself this weekend [0]. I'm not convinced that 'torch.cuda' is really that bad since the AMD version of PyTorch just translates that for you. More like a naming problem, than anything. Fact is that it is just as easy to grab the rocm:pytorch container, as it is the rocm:jax container. I don't see very many numbers posted. What MFU did you get? [0] https://x.com/HotAisle/status/1837580046732874026 https://x.com/HotAisle/status/1837580046732874026