4 ms·
Only $5M then.
by wmf 3y ago
Only $5M then.
- LoganDark 3y agoI'm pretty sure $20,000 per LPU isn't actually the cost of these LPUs. I saw someone else on HN asking if $20,000 could get them something and an employee said to reach out. Which makes me think $20,000 is enough to get some sort of model running at least, even if it's not necessarily an LLM.
- int_19h 3y ago$5M once, upfront. But given the significantly increased throughput, how fast does that pay for itself?
- fzzzy 3y agoYou need computers for all of them and megawatts of power, power supplies, cooling, and power distribution.
- int_19h 3y agoNaturally, but you need that for GPUs as well, no? What is the actual difference when running, when measured per token generated?
- gessha 3y agoDepends on power usage. I’m curious how power hungry those are compared to server/workstation cards.