4 ms·
A few months back, a lot of the most powerful GPU instances on GCP seemed to be sold out 24/7. I suppose it's possible Google's own infrastructure is partition
by michaelt 2y ago
A few months back, a lot of the most powerful GPU instances on GCP seemed to be sold out 24/7.
I suppose it's possible Google's own infrastructure is partitioned from GCP infrastructure, so they have a bunch of idle GPUs even while their cloud division can sell every H100 and A100 they can get their hands on?
- dmurray 2y agoI'd expect they have both: dedicated machines that they usually use and are sometimes idle, but also the ability to run a job on GCP if it makes sense. (I doubt it's the other way round, that the Deepmind researchers could come in one day and find all their GPUs are being used by some cloud customer).