2 ms·

Here is another paper on large batches https://arxiv.org/abs/1705.08741 https://arxiv.org/abs/1705.08741 It is better written and has more information IMHO