3 ms·
Releasing the weights for a 1T+ parameter model doesn't really help "the little guy" when it costs ~$50K per H200 and 8 of them aren't enough to run a single no
by sgammon 21d ago
Releasing the weights for a 1T+ parameter model doesn't really help "the little guy" when it costs ~$50K per H200 and 8 of them aren't enough to run a single node.
Somehow this plan manages to lean into every single bad outcome
- andai 21d agoI think the main argument was "intentionally commit economic suicide to slow the development of dangerous AI." (That being said, Chinese labs are releasing weights, so I'm not sure how the economics actually work.)
- sgammon 21d ago> The big companies can afford the compliance teams and lawyers to keep up, and each new requirement makes it harder for anyone else to catch them It also takes a lot to do anything with a 1T+ parameter model. Arguably there is still an immense capital moat. So I'm not sure it would even have the effect the author intends.
- nijave 21d agoProviders can compete on cost which is a small but positive outcome. It also encourages providers to find more efficient ways to serve models which also lowers cost. That said, these frontier models are still astronomically huge.