3 ms·
An ongoing research problem. OpenAI would certainly like being able to use smaller GPUs, instead of having to fit the entire model into one.
by Filligree 6y ago
An ongoing research problem. OpenAI would certainly like being able to use smaller GPUs, instead of having to fit the entire model into one.
- jne2356 6y agoGPT-3 does not fit in any one GPU that exists at present. It's already spread out across multiple GPUs.