3 ms·
Chinese models most likely are distillations of frontier models with tricks for subpar hardware. If you want to be ahead of the us labs you need to spend billio
by noosphr 3mo ago
Chinese models most likely are distillations of frontier models with tricks for subpar hardware. If you want to be ahead of the us labs you need to spend billions for pretraining from scratch.
- tw1984 3mo agoIf that is the case, it means one thing only - US labs don't have moat whatsoever and their expectation to have trillion dollar valuation is just laughable.
- noosphr 3mo agoThe moat is the compute.
- trollbridge 3mo agoThe compute for training, or for inference?
- aae42 3mo agoYes