4 ms·
They just be doing something crazy because any time I query my local llm the lights in my office dim and the temperature rises a few degrees. Definitely far mor
by WD-42 1y ago
They just be doing something crazy because any time I query my local llm the lights in my office dim and the temperature rises a few degrees. Definitely far more energy than running the microwave for 1 second.
- oskarkk 1y agoWhat hardware runs your local LLM?
- WD-42 1y agoA RTX 5080, not the lowest power card.
- oskarkk 1y agoNot the lowest power, but surely it uses less power than a microwave. 360W TDP, 850W required system power, while my microwave is 1000W.
- WD-42 1y agoThe difference is most prompts take far longer than a single second to return.
- oskarkk 1y agoYeah, but couple hundred watts certainly shouldn't dim your lights.
- bruckie 1y agoAnd if it does, you should get your wiring checked! If voltage is sagging enough to dim your lights with such a small load, that indicates a lot of resistance somewhere in the wiring, which could lead to fires.