2 ms·
Because hosting a really GOOD model requires hardware that costs tens of thousands of dollars. It's much cheaper to timeshare that hardware with other users th
by simonw 1y ago
Because hosting a really GOOD model requires hardware that costs tens of thousands of dollars.
It's much cheaper to timeshare that hardware with other users than to buy and run it yourself.
- realz 1y agoThat may be true for independent devs or startups. Larger companies have enough demand to justify a few A/H100s.