4 ms·
> I actually didn't think this would work at all without nvlink. It will work, but with less memory bandwidth. If using hacked drivers with p2p enabled, it wil
by ai-christianson 2y ago
> I actually didn't think this would work at all without nvlink.
It will work, but with less memory bandwidth. If using hacked drivers with p2p enabled, it will depend on the PCIe topology. Otherwise, the data will take a longer path.
Depending on the model, it may not be that big of a hit in performance. Personally, I have seen higher perf on nvlinked GPUs and models that can fit on 2x 3090 24gbs.
- reginald78 2y agoYes, no one seemed to be bragging about much of a performance boost. I think they were happy being able to run models (at any speed) that needed 24GB without having to buy a 3090.