4 ms·
You don't need nvlink for inference with models that need to fit in multiple cards. I'm using a laptop with a 3080 ti mobile and a 3090 in an eGPU enclosure for
by cthalupa 3y ago
You don't need nvlink for inference with models that need to fit in multiple cards. I'm using a laptop with a 3080 ti mobile and a 3090 in an eGPU enclosure for running LLM models over 24GB.