3 ms·
2.5x the scaling efficiency, so 4 times the price? What is happening here? Did the subsidies dry up with the discrepancy between chinese and US models?
by Aeolun 3mo ago
2.5x the scaling efficiency, so 4 times the price? What is happening here? Did the subsidies dry up with the discrepancy between chinese and US models?
- petu 3mo agoIt's also 2.8x parameter count (1T -> 2.8T), likely higher activation per token (50B?).
- pixl97 3mo agoScaling efficiency simply means if you took the first small model and scaled it up to the big model it would take 2.5x the resources to run. Not the that larger model is going to be any cheaper. Kind of like scaling your personal automobile to the weight of a semi, the semi is still going to be far more efficient in moving cargo, not that the semi will cost the same to operate as the original car.