2 ms·It has a total latency of 200ms on a A100 40G.by GaggiX 3y agoIt has a total latency of 200ms on a A100 40G.