4 ms·Using TPUs is expensive. Also some applications may need small latencyby struxure 7y agoUsing TPUs is expensive. Also some applications may need small latency