3 ms·
The article addresses that: > This problem is far too small to saturate the GPU, even with such a large batch size. Time is dominated by moving batches from th
by Sukera 4y ago
The article addresses that:
> This problem is far too small to saturate the GPU, even with such a large batch size. Time is dominated by moving batches from the CPU to the GPU. Unfortunately, as the batch sizes get larger, we need more epochs to reach the same accuracy, so we can hit a limit in terms of maximizing accuracy/time.
The batch size in their example is 2048.