3 ms·

GPT-3 does not fit in any one GPU that exists at present. It's already spread out across multiple GPUs.