3 ms·
How is China training models without access to cutting edge GPUs?
by elorant 2y ago
How is China training models without access to cutting edge GPUs?
- kristjansson 2y agoPretty easily, it turns out?
- pixelesque 2y agoThey're being more efficient about it by the looks of things, rather than brute-forcing things... https://x.com/karpathy/status/1872362712958906460 https://x.com/karpathy/status/1872362712958906460
- ryao 2y agoThey have access to cutting edge GPUs via rentals: https://www.msn.com/en-us/money/markets/bytedance-plans-to-sidestep-us-sanctions-by-renting-nvidia-gpus-in-the-cloud-report-says-it-has-set-aside-7-billion-budget/ar-AA1wLF5A https://www.msn.com/en-us/money/markets/bytedance-plans-to-s...
- rajamaka 2y agoThe same way drug users access illegal drugs.
- arthurcolle 2y agovery carefully
- HarHarVeryFunny 2y ago- using non-cutting edge GPUs (just more of them) - creating more efficient models such as MoE based DeepSeek - getting their hands on cutting edge GPUs all the same I think it was Dylan Patel (from semianalysis) on Dwarkesh that mentioned one scam is for a Chinese source to arrange for a SOTA NVidia cluster to be bought/installed in some non-embargoed country, then dismantled and shipped to China.