3 ms·
No, and at $4000+ per 5090, I'm unlikely to have any experience anytime soon.
by seanmcdirmid 2mo ago
No, and at $4000+ per 5090, I'm unlikely to have any experience anytime soon.
- angoragoats 2mo agoYou can parallelize inference with much cheaper GPUs as well! I’ve got a 4060 ti 16gb, and I’m thinking about getting another. I previously specced out a cluster using multiple 3090s. At the time, the 3090s were going for $700 on eBay. They’re more than that now, but there’s no need to spend $4k per GPU at all.