3 ms·
Azure and such get such massive scaling cost benefits from scaling that HF's own GPUs would probably be more expensive anyway, even if they go AMD/Intel. It do
by brucethemoose2 3y ago
Azure and such get such massive scaling cost benefits from scaling that HF's own GPUs would probably be more expensive anyway, even if they go AMD/Intel.
It does seem like they should run their own storage nodes, with the sheer quantity of models they host...
- fxtentacle 3y agoEveryone claims that, yet I have never seen it happen. Typically, small companies get rebates on NVIDIA GPUs, but big established ones do not. So I would expect a startup with 100 GPUs to pay less per GPU than Azure.