3 ms·
Read up on the datacenter OpenAI had to spin-up within Azure in order to train GPT3. A little out of reach for now - but in 10 years, who knows.
by xenospn 4y ago
Read up on the datacenter OpenAI had to spin-up within Azure in order to train GPT3. A little out of reach for now - but in 10 years, who knows.
- jchw 4y agoTo be fair, training is a lot more intensive than inference. Though if open source models are any indication, the big issue is actually VRAM requirements.