3 ms·
I'm pretty confident that part of OpenAI's competitive edge is that they can train these models on GIANT clusters of machines. This article predicts that GPT-3
by simonw 5y ago
I'm pretty confident that part of OpenAI's competitive edge is that they can train these models on GIANT clusters of machines.
This article predicts that GPT-3 cost $10-$20m to train. I imagine DALL-E could cost even more: https://lastweekin.ai/p/gpt-3-is-no-longer-the-only-game?s=r https://lastweekin.ai/p/gpt-3-is-no-longer-the-only-game?s=r