2 ms·
It was made to be small out of necessity. The US government put extensive export controls on many inter-GPU connectivity products last year and expanded those c
by genidoi 3y ago
It was made to be small out of necessity. The US government put extensive export controls on many inter-GPU connectivity products last year and expanded those controls recently to include anything above an A100.
Page 9 of this recently published paper[1] is a strong indicator of how far non-US firms go to formally analyze and factor in these bandwidth constraints in building large models.
[1] https://arxiv.org/pdf/2311.15786v2.pdf https://arxiv.org/pdf/2311.15786v2.pdf
- Reubend 3y agoAh, that makes sense. Is it possible for those researchers to just rent cloud compute, or is that also prohibited? I suppose that the obvious thought in my mind would be to find some cheap cloud GPU provider and use their platform to do the training. But maybe they're more concerned about inference afterwards, and so that doesn't really solve their issue.