Nvidia is reliably flexible, so, by the time you are investing hundreds of thousands of compute hours for training a new model, your lowest risk effort is to do

Nvidia is reliably flexible, so, by the time you are investing hundreds of thousands of compute hours for training a new model, your lowest risk effort is to do this with Nvidia chips. Do you want to risk the slowdowns and hiccups that could be caused by being one of the first to train huge models on alternative software/hardware? If you aren't using Nvidia for the cutting edge research you are actually using your research for two things. 1) Normal cost of training 2) proof of concept for training huge new models on new to market hardware. Nvidia doesn't really have a definite lead for 'faster and more energy efficient', there are competitors that look like good alternatives.