4 ms·
Given the restrictions on GPUs to China, I'm curious what their training cluster looks like. (not saying this out of any support or non-support for such a GPU
by andy_xor_andrew 2y ago
Given the restrictions on GPUs to China, I'm curious what their training cluster looks like.
(not saying this out of any support or non-support for such a GPU blockade; I'm just genuinely curious)
- ComputerGuru 2y agoThey probably buy them through intermediaries.
- blackoil 2y agoThey can train it in a data center in Singapore or Taiwan!!
- throwing_away 2y agowhy is this being downvoted? isn't this what is actually happening?
- 0cf8612b2e1e 2y agoThe restrictions are fairly recent. Unless a Stuxnet disables all GPUs in the country, there is probably a lot of existing infrastructure.
- bx376 2y agoI believe besides the legacy Nvidia cards, Alibaba has built training clusters from domestic AI accelerator vendor like https://e.huawei.com/en/products/computing/ascend https://e.huawei.com/en/products/computing/ascend. But that means a lot of extra in-house engineering work to utilize those niche hardware.
- rfoo 2y agoA100s, (old) A800s, H100s or (old) H800s. How did they get them? Who knows, but it's there.
- halJordan 2y agoBaidu specifically claims they have orchestration technology to train on heterogeneous gpu clusters.
- erwald 2y agoCould you share the source on that?
- mavoince 2y ago[dead]
- schneehertz 2y agokeyword: Ascend 910B