3 ms·
$5M once, upfront. But given the significantly increased throughput, how fast does that pay for itself?
by int_19h 3y ago
$5M once, upfront. But given the significantly increased throughput, how fast does that pay for itself?
- fzzzy 3y agoYou need computers for all of them and megawatts of power, power supplies, cooling, and power distribution.
- int_19h 3y agoNaturally, but you need that for GPUs as well, no? What is the actual difference when running, when measured per token generated?
- gessha 3y agoDepends on power usage. I’m curious how power hungry those are compared to server/workstation cards.