3 ms·
GPT-3 was trained on 1024 GPUs, which is hardly a blip on NVIDIA sales radar. Tuning an existing model, if you can get your hands on it is probably a lot less d
by varjag 3y ago
GPT-3 was trained on 1024 GPUs, which is hardly a blip on NVIDIA sales radar. Tuning an existing model, if you can get your hands on it is probably a lot less demanding.