4 ms·
They have been catching up pretty fast though. Since US have banned Nvidia chips export upto a certain extent to them they are coming up with more optimized tra
by anishgupta 9mo ago
They have been catching up pretty fast though. Since US have banned Nvidia chips export upto a certain extent to them they are coming up with more optimized training at least which is why US should be wary of them. China does more with less
- meisel 9mo agoHow much less? Their companies clearly have access to the latest GPUs.
- anishgupta 9mo agoThis video can bring some perspective https://www.youtube.com/watch?v=CrJJPlRO9bI https://www.youtube.com/watch?v=CrJJPlRO9bI around 5:11 They use H800 as opposed to major US ones on H100 (2-3x faster)
- eptcyka 9mo agoDefinitely. And there’s lots of wasteful training practices in Singapore too.
- jacquesm 9mo agoThis story has so many repeats by now it should be taught in schools. Constraints breed improvements, time and again. Whether in the petri dish or in a tech domain, if you want to see greatness substitute the latest and greatest for something that is two generations older and watch the miracle unfold. What doesn't kill you really does make you stronger.
- ilamont 9mo agoThe US and China regularly use export controls (like the Nvidia ban), joint ventures, and legislation as levers of power over the other side. For American and other non-PRC companies thinking of using Chinese models, doesn't this have to be balanced with the risk that the US or its leadership may kneecap the Chinese models through export controls, an executive order, or some other means?
- 1970-01-01 9mo agoPerhaps they're catching up because there's a massive problem with AI growth that is finally taking shape. Perhaps this is the end of the growth curve and the beginning of a flatline.