Doesn't this literally not matter? We know that something Llama is being trained in about 3 months on Meta's current resources from their current datasets. If

Doesn't this literally not matter? We know that something Llama is being trained in about 3 months on Meta's current resources from their current datasets. If they had less GPU power available, it would take longer but not dramatically so. Building a "more powerful AI cluster" doesn't give you a more powerful AI currently. In fact none of the Transformer architecture's seem to, and their instantiations seem to all be targeted towards "single H100 executions" for inference. So this really does seem like nothing but hype: buying a lot of commercially available GPUs isn't accomplishing anything.