2 ms·
No need for NVLink just for inference, not even with tensor parallelism. And you can get used 3090 much cheaper than that.
by Manabu-eo 2y ago
No need for NVLink just for inference, not even with tensor parallelism. And you can get used 3090 much cheaper than that.
- wkat4242 2y agoTrue, you can buy 2x 4090 FE brand new for $4000