That post doesn't specify whether the training was fine with single or half precision floating point. Given that it's on the website of an AMD GPU cloud provide

That post doesn't specify whether the training was fine with single or half precision floating point. Given that it's on the website of an AMD GPU cloud provider, I tend to think they probably used fp32 since it will make vega look better.