4 ms·
> China's biggest challenge ATM is that they do not yet economically produce the GPUs and RAM needed to train and use big models. They are still behind in semic
by tw1984 2y ago
> China's biggest challenge ATM is that they do not yet economically produce the GPUs and RAM needed to train and use big models. They are still behind in semiconductors, maybe 10 or 20 years (they can make fast chips, they can make cheap chips, they can't yet make fast cheap chips).
You don't need the most efficient chips to train LLMs. those much slower chips (e.g. those made by Huawei) will probably take longer for training and they waste more electricity and space. but so what?
- int_19h 2y agoAnd lest we forget, China is not bothered by building as many nuclear power plants as it needs.
- tw1984 2y agobecause Chinese is investing heavily on all sorts of renewable energies. its annual investment is more than the total US and EU amount combined. "China is set to account for the largest share of clean energy investment in 2024 with an estimated $675 billion, while Europe is set to account for $370 billion and the United States $315 billion." https://www.reuters.com/sustainability/climate-energy/iea-expects-global-clean-energy-investment-hit-2-trillion-2024-2024-06-06/ https://www.reuters.com/sustainability/climate-energy/iea-ex...
- seanmcdirmid 2y agoEconomy isn’t efficiency, China has a yield problem on the chips they need, and that reduces their progress.