Not sure how much inference on the edge will impact things unless you think we’ll hit “peak training” in the near future. I would safely wager that most H100 no

Not sure how much inference on the edge will impact things unless you think we’ll hit “peak training” in the near future. I would safely wager that most H100 nodes will be used for training rather than inference.