Meta had the equivalent of about 600K H100 cards a year ago, but they were geographically distributed and used mostly for inference. These giant data centres w

Meta had the equivalent of about 600K H100 cards a year ago, but they were geographically distributed and used mostly for inference. These giant data centres will allow these companies to put about a million in one location and possibly into a single giant training cluster.