3 ms·

Have you looked into using DALI [1] to do augmentation on GPU? They've gotten some nice speedups for computer vision that way. [1] https://devblogs.nvidia.com/

• m0zg 6y ago
  Of course, I've looked at everything. Given how expensive modern GPUs are, it is best to use their resources for deep learning rather than augmentation. That way you also get to pipeline augmentation: while GPU is doing the forward/backward pass, the CPU is also cranking out the next batch, so in a way, you're utilizing the resources better. Another issue is, DALI only supports a subset of augmentations that e.g. Albumentations supports, and I'd much rather be working on the "neural" bits than wrestling with augmentation algorithms.