4 ms·
at present you do seem to need a lot of cutting edge GPUs, which have much more centralized production than ore and centrifuges
by nyolfen 3y ago
at present you do seem to need a lot of cutting edge GPUs, which have much more centralized production than ore and centrifuges
- varjag 3y agoGPT-3 was trained on 1024 GPUs, which is hardly a blip on NVIDIA sales radar. Tuning an existing model, if you can get your hands on it is probably a lot less demanding.