3 ms·
Can you actually stack multiple 3090s arbitrarily like that? That is use multiple 3090s to load a single model for inference. I thought that at most you could
by sireat 4y ago
Can you actually stack multiple 3090s arbitrarily like that?
That is use multiple 3090s to load a single model for inference.
I thought that at most you could use two 3090s via NVlink.
Stacking multiple cards would open some real cheap options.
Like a real budget option would be something like a few ancient K80s (24GB version). eBay price was around $200-300 last I checked.
.