3 ms·One can also use shallow transformer models if inference throughput is important.by riku_iki 6y agoOne can also use shallow transformer models if inference throughput is important.