4 ms·
6 Mac Studios for 100k USD. Consider it a rule of thumb now - 100k to run 1T params, scales linearly.
by bewareofscams 1mo ago
6 Mac Studios for 100k USD.
Consider it a rule of thumb now - 100k to run 1T params, scales linearly.
- MPSimmons 1mo agoOut of curiosity, what do you do to distribute the weights and inference across the multiple machines?
- fzzzy 1mo agoThunderbolt 5, and software
- NamlchakKhandro 1mo agoat a 100k$ you're not buying apple products to be limited by the 120gb/s thunderbolt port.
- root_axis 1mo agoIf you have 100k you can just buy a few b200s.
- blints 1mo agoOne does not simply "buy a few b200". They come in 8 packs minimally, at >5x that budget.