2 ms·
I don't get it. Training giant LLMs can easily be task managed to line up with solar and wind availability. Shut off half the DC at night, go full power when it
by eqvinox 1y ago
I don't get it. Training giant LLMs can easily be task managed to line up with solar and wind availability. Shut off half the DC at night, go full power when it's sunny and windy. If they integrate the powerplant, they can easily manage this.
Is avoiding HW underutilization really worth going nuclear? The most expensive energy source of all?
- looofooo0 1y agoWell then you only get 50% of your compute, hence your compute is twice as expensive (ignoring power costs.)
- eqvinox 1y agoI guess I'm sufficiently divorced from ops as to not know what the relationship of these costs is. I had assumed that power & cooling is a notable factor, but it sounds like the silicon itself is a majority of the cost?
- looofooo0 1y agoThink 20% power cost, 80% infrastructure where most are fixed cost.