3 ms·
With training improvements such as DeepSpeed, the GPU costs will likely be substantially lower than what was available at the time OpenAI trained GPT-3. Still n
by minimaxir 6y ago
With training improvements such as DeepSpeed, the GPU costs will likely be substantially lower than what was available at the time OpenAI trained GPT-3. Still not free, though.
The hard part with GPT-3 is it's big enough to make it difficult to actually deploy.