It's pretty bad: https://www.datacenterdynamics.com/en/news/meta-report-details-hundreds-of-gpu-and-hbm3-related-interruptions-to-llama-3-training-run/ https://

It's pretty bad: https://www.datacenterdynamics.com/en/news/meta-report-details-hundreds-of-gpu-and-hbm3-related-interruptions-to-llama-3-training-run/ https://www.datacenterdynamics.com/en/news/meta-report-detai... Jensen said they added a lot of RAS in Blackwell which kind of admits Hopper wasn't reliable enough.