7 ms·
Why use electricity alone for open models? Surely you’d want to spread the cost of hardware over the period too?
by sarjann 29d ago
Why use electricity alone for open models? Surely you’d want to spread the cost of hardware over the period too?
- Grombobulous 29d agoI think the key there is “hardware you already own.” If you own a graphics card you bought for gaming or a laptop you bought for doing schoolwork there is $0 in cost of local AI tokens, because 100% of the cost was assigned to doing other things.
- datadrivenangel 29d agoIt's bad accounting to only look at marginal cost and ignore depreciating hardware asset costs.
- deleted 29d ago[deleted]
- deleted 28d ago[deleted]
- pixl97 29d agoGod, I'd love to have more local VRAM but the card costs are out of control. Based on these costs I'd almost expect the amount of gaming graphics memory to go down over the next few years putting more stress on running those local models.