With 60$K you can also get a Lambda box wiht 8GPUs, 16 CPU cores and 256Gb system memory (plus 8x48GB VRAM on the GPUs). You can't train GPT-3 with it but just

With 60$K you can also get a Lambda box wiht 8GPUs, 16 CPU cores and 256Gb system memory (plus 8x48GB VRAM on the GPUs). You can't train GPT-3 with it but just about anything else.