3 ms·
No offense intended to your personal experience, but I don't think "small independent cloud" is terribly important in the global analysis. This paper concludes
by jeffbee 4y ago
No offense intended to your personal experience, but I don't think "small independent cloud" is terribly important in the global analysis. This paper concludes that TDP and TCO have become the same thing, i.e. power is heat, power is opex.
https://www.gwern.net/docs/ai/scaling/hardware/2021-jouppi.pdf https://www.gwern.net/docs/ai/scaling/hardware/2021-jouppi.p...
- ranman 4y agoOne key call out re: power from that paper - "Most OpEx cost is for provisioning power and not for electricity use [2], so saving power already provisioned for doesn’t improve TCO as much as one might hope."