4 ms·
The energy costs in the bay area are double the reported 24c cost, so energy alone would be around $100-ish a month instead of $50-ish.
by theogravity 2y ago
The energy costs in the bay area are double the reported 24c cost, so energy alone would be around $100-ish a month instead of $50-ish.
- pkaye 2y agoUnless you are in Santa Clara with Silicon Valley Power rates. https://www.siliconvalleypower.com/residents/rates-and-fees https://www.siliconvalleypower.com/residents/rates-and-fees
- veryrealsid 2y agoYeah agreed, some of the areas we have access to were 16c (PA) and up to 24c (NYC), doubled that cost in the analysis because of things like this
- angoragoats 2y agoExcept that the article assumes that the GPUs would be using their max TDP all the time, which is incorrect. GPUs will throttle down to 5-20w (depending on the specific GPU). So your actual power consumption is going to be much, much lower, unless you’re literally using your LLM 24/7.