3 ms·

This benchmark is worth looking at as well: blog.gpueater.com/en/2018/04/23/00011_tech_cifar10_bench_on_tf13/