Interesting. I was renting H100 and they always produced different results than running on M1 or 5080. In the end I was not able to train anything on H100, as

Interesting. I was renting H100 and they always produced different results than running on M1 or 5080. In the end I was not able to train anything on H100, as my models were collapsing quickly, whereas on M1 or 5080 exact same models with the same params trained just fine. For instance on H100 model would be dead at epoch 100, whereas same model would train fine 50000 epochs and beyond on M1 or 5080.