3 ms·
to me the biggest event more than deepseek launch was when zAI served their latest model on all Chinese chips.
by dzonga 27d ago
to me the biggest event more than deepseek launch was when zAI served their latest model on all Chinese chips.
- genxy 27d agoModel serving is trivial, and inference is just memory bandwidth. The cost of serving will be asymptotic to flash read energy. Having trained on your own chips, that is the impressive part.
- g8oz 27d agoModel serving and inference will be trivial in the long term, right now it's a real choke point. Being able to do that with domestic chips is an important win.