2 ms·

For inference, Nvidia has DLA since 2017-ish if I remember correctly, which is completely separate from the GPU.