3 ms·
What hardware runs your local LLM?
by oskarkk 1y ago
What hardware runs your local LLM?
- WD-42 1y agoA RTX 5080, not the lowest power card.
- oskarkk 1y agoNot the lowest power, but surely it uses less power than a microwave. 360W TDP, 850W required system power, while my microwave is 1000W.
- WD-42 1y agoThe difference is most prompts take far longer than a single second to return.
- oskarkk 1y agoYeah, but couple hundred watts certainly shouldn't dim your lights.
- bruckie 1y agoAnd if it does, you should get your wiring checked! If voltage is sagging enough to dim your lights with such a small load, that indicates a lot of resistance somewhere in the wiring, which could lead to fires.