> How many false start does it take before you do that run with 128TPUs "for a few weeks" that works? This is a big issue that most people miss. Having easy ac

> How many false start does it take before you do that run with 128TPUs "for a few weeks" that works? This is a big issue that most people miss. Having easy access to vast computational power makes such a difference for experimentation.