13 ms·
Seriously. People fuss over LLM energy consumption, but I did the math on my rig, and if I were to use my machine at full tilt for all of my waking hours, I wou
by Zambyte 2mo ago
Seriously. People fuss over LLM energy consumption, but I did the math on my rig, and if I were to use my machine at full tilt for all of my waking hours, I would use roughly 1/10th the amount of energy the average American uses driving.
By the way, I highly recommend the Priority 600 :-)
- infinitezest 2mo agoI think OP is talking about datacenters which likely use a little more power than your home rig.
- the_sleaze_ 1mo agoExtrapolate
- Zambyte 1mo agoAnd I use SOTA models that are hosted on hardware I don't have access to a handful of times a month at this point, and most of the people I talk to regarding LLM usage are either in the same boat, or are asking about hosting things themselves. The diminishing returns for using the best of the best models just aren't worth it for most things anymore.