3 ms·
It's not impossible to distribute training across multiple GPUs, but it's certainly not straightforward. And if you want activations for an entire 4K image in
by dplavery92 6y ago
It's not impossible to distribute training across multiple GPUs, but it's certainly not straightforward. And if you want activations for an entire 4K image in the same model, having a lot of memory on one card is your friend.