I recommend reading the entire article Together with SpaceXAI, we're training a significantly larger model from scratch, using 10x more total compute. With

I recommend reading the entire article Together with SpaceXAI, we're training a significantly larger model from scratch, using 10x more total compute. With Colossus 2's million H100-equivalents and our combined data and training techniques, we expect this to be a major leap in model capability.