4 ms·
To be honest, China not having access to the latest hardware is exactly what has driven LLM technology forward the last 2 years.
by throwa356262 5mo ago
To be honest, China not having access to the latest hardware is exactly what has driven LLM technology forward the last 2 years.
- humanfromearth9 5mo agoWhy?
- Weryj 5mo agoBecause it forced them to focus on efficiency, instead of throwing more compute at the problem. Just like in software, some of the most beautiful solutions come from constraints. Think, the optimisations that game developers implemented because of the frame budget.
- Viacol 5mo agoOn top of that, China is also facing hardware constraints, which is pushing companies to develop better domestic chips for AI training. It'll be interesting to see how things perform once Huawei's newer hardware is fully deployed at DeepSeek.