The approach could prove useful in a single machine too -- for example, in cases where increasing batch size might improve the efficiency of shuffling data back

The approach could prove useful in a single machine too -- for example, in cases where increasing batch size might improve the efficiency of shuffling data back and forth from main memory to GPU memory. This provides an easy recipe for trying larger batch sizes to increase GPU usage.