3 ms·
Happens with Google cloud too, sometimes for weeks at a time. It's pretty sad how Google/Amazon can't at least temporarily move their own workloads to free up
by londons_explore 5y ago
Happens with Google cloud too, sometimes for weeks at a time.
It's pretty sad how Google/Amazon can't at least temporarily move their own workloads to free up resources for their public clouds while they install new hardware.
- H8crilA 5y ago> free up resources (...) while they install new hardware That's likely not the reason. It's more likely caused by inherent spike-y ness of the traffic, given that most GPU instances are probably used for batch numerical computations (like training neural networks). The pricing incentivizes using a lot of nodes for a shorter amount of time, much like in the SHA example.
- londons_explore 5y agoThe pricing incentivises spot nodes, which use dynamic pricing to try to prevent this...
- dspillett 5y agoThey are never going to significantly prioritise “public” cloud resource over internal needs, beyond own needs having quotas to make sure they don't run amok if something gets unexpectedly out of shape. If their own public services slowed down in high demand times, it wouldn't look good. The sales channels could try to spin it as “giving you priority over us” but who would genuinely believe them. They could reduce resources available to low priority internal stuff during spikes of other activity, but that would not have a large effect considering the combined size of activity on the public cloud resources.