Nice! I need to calculate MFU. GPU, VRAM details can be found in the repo: https://dub.sh/amd-405b-res https://dub.sh/amd-405b-res. I plan to reattempt the tr

Nice! I need to calculate MFU. GPU, VRAM details can be found in the repo: https://dub.sh/amd-405b-res https://dub.sh/amd-405b-res. I plan to reattempt the training run next weekend and JIT the entire training step to calculate MFU then