3 ms·
Sure, but once you've justified moving data onto the GPU you don't want to incur the cost of moving the operation output back to the CPU unless you have to. So,
by HarHarVeryFunny 2y ago
Sure, but once you've justified moving data onto the GPU you don't want to incur the cost of moving the operation output back to the CPU unless you have to. So, for example, you might justify moving data to the GPU for a neural net convolution, but then also execute the following activation function (& subsequent operators) there because that's now where the data is.
- leeter 2y agoSo awhile back I was working on a chaotic renderer. This let me to a really weird set of situations: * If the GPU is a non-dedicated older style intel GPU, use CPU * If the GPU is a non-dedicated anything else do anything super parallel on the GPU but anything that can be BRRRRRT via CPU on the CPU because the memory is shared. * If the GPU is dedicated move everything to GPU memory and keep it there and only pull back small statistics if at all plausible.