4 ms·
But Anthropic isn't paying for the electricity and cooling. They don't run their own data centers, they rent compute from providers who cover those costs. That
by tristanj 6d ago
But Anthropic isn't paying for the electricity and cooling. They don't run their own data centers, they rent compute from providers who cover those costs.
That's entirely why they can blow compute on the fun projects like this. If they had to pay extra for the electricity, they wouldn't do it.
- Barbing 6d agoIs the electricity cost far greater than the marketing value?
- rightnutwingjob 6d agoThe first is a physical quantity that can be written down. The second is approximately no better than astrology.
- ehe78qhe 6d agoThe second point is, sadly, true of quite a lot of aspects of software, including "design" and "quality"
- nullsanity 6d ago[dead]
- adastra22 6d agoThe marginal electricity cost is zero.
- londons_explore 6d agoBut training LLM's is also a task one can do whenever you have a spare GPU-minutes. I wonder why they don't have some kind of scheduler which makes sure there are never any idle minutes. One would imagine they at least would have autoscaling on their production serving workload and use the freed compute capacity for model training for example.
- esseph 6d agoI doubt they're inferencing on their training hardware