3 ms·
Which isn't that much when you compare to the kind of DC that US actors are using.
by stymaar 18d ago
Which isn't that much when you compare to the kind of DC that US actors are using.
- brookst 18d agoDo we know what kind of DC US actors are using specifically for training, versus inference and delivery?
- stymaar 17d agoI remember Zuck bragging about using a 100MW DC for training, and Musk's Colosus was supposed to be a training data center (but they fucked up the design so they had to repurpose it to an inference one).
- lostmsu 17d agoThat's posttraining. Pretraining is the expensive part.