> It's plainly obvious when you run even the very modest AI models at home how much power these things take. Really good point to put this into perspective. I

> It's plainly obvious when you run even the very modest AI models at home how much power these things take. Really good point to put this into perspective. I tried models locally and my gpu was running red hot. Granted, I think the server boards like H100 are more optimized for the AI workloads so they run more efficiently than consumer gpus, but I don't believe they are more than 1 magnitude more efficient.