Without NVLink different layers are loaded onto individual cards and only one card often has to wait for the other card, slowing down generation. It's still fas

Without NVLink different layers are loaded onto individual cards and only one card often has to wait for the other card, slowing down generation. It's still faster than CPU offloading. You can even mix and match GPUs like a 4090 + 3060.