4 ms·
I'm in the business of mi300x. This comment nails it. In general, the $2 GPUs are either PE venture losing money, long contracts, huge quantities, pcie, slow (
by latchkey 2y ago
I'm in the business of mi300x. This comment nails it.
In general, the $2 GPUs are either PE venture losing money, long contracts, huge quantities, pcie, slow (<400G) networking, or some other limitation, like unreliable uptime on some bitcoin miner that decided to pivot into the GPU space and has zero experience on how to run these more complicated systems.
Basically, all the things that if you decide to build and risk your business on these sorts of providers, you "get what you pay for".
- jsheard 2y ago> slow (<400G) networking We're not getting Folding@Home style distributed training any time soon, are we.
- krasin 2y agoDistributed training data creating & curation is more useful and feasible. Training gets cheaper 1.5x every year, but data is just as expensive, if not more, given that the era of "free web crawls of human knowledge" is over.