Depends on if you're talking about training performance or inference performance. It's probably a decent deal for inference on such large models, but I doubt it

Depends on if you're talking about training performance or inference performance. It's probably a decent deal for inference on such large models, but I doubt it's anywhere near competitive for training. In the 'consumer' space there's also the A6000 with 48GB for ~$4k.