Either way, I'd encourage trying out multi-GPU training. The latest NVLINK is pretty impressive, and reducing your iteration time for free (because linear prici

Either way, I'd encourage trying out multi-GPU training. The latest NVLINK is pretty impressive, and reducing your iteration time for free (because linear pricing) is pure goodness.