3 ms·
Exactly, it covered in the article that there is a segmentation happening via GPU cluster size. Is it big enough for foundation model training from scratch = ~
by pico_creator 2y ago
Exactly, it covered in the article that there is a segmentation happening via GPU cluster size.
Is it big enough for foundation model training from scratch = ~$3+
Otherwise it drops hard
Problem is "big enough" is a moving goal post now, what was big, becomes small
- swyx 2y agoso why not buy up all the little h100s and enough together for a cluster? seems like a decent rollup strategy? ofcourse it woudl still cost a lot to do... but if the difference is $2/hr vs $4.49/hr then there's some size where it makes sense
- pico_creator 2y agoMakes sense, though only folks like runpod / sfcompute / etc, have enough visibility to maybe pull this off? Its a risker move - then just taxing the excess compute now, and print money on the margins from bag holders
- latchkey 2y agoCorrect me if I'm wrong, but if I recall, neither of those two companies own their own compute. They are marketplaces.
- pico_creator 2y agoYup, but they at-least know where all these "small unused clusters" are. Bag holders, do not want to be shouting to the world they are bag holders.
- qeternity 2y agoI think sfcompute does own a lot or most of the current compute on their platform? Not entirely sure though.
- ipsum2 2y agoOnly if they're networked with Infiniband.