3 ms·
Because there aren't that many clusters and the ones that exist are tightly controlled. there are only a handful of data centers able to run the largest models
by doug_durham 2mo ago
Because there aren't that many clusters and the ones that exist are tightly controlled. there are only a handful of data centers able to run the largest models and they're being used at full capacity people would notice if suddenly the capacity went down a lot because it was being used by a different system.