3 ms·
Have you compared 3x 3090-3090 pairs over NVLink? IMO the most painful thing is that since these hardware configurations are esoteric, there is no software tha
by doctorpangloss 3y ago
Have you compared 3x 3090-3090 pairs over NVLink?
IMO the most painful thing is that since these hardware configurations are esoteric, there is no software that detects them and moves things around "automatically." Regardless of what people thing device_map="auto" does, and anyway, Hugging Face's transformers/diffusers are all over the place.