3 ms·Ultra-Fast Inference On Own Infrastructure With 1ms latency for BERT-like models2 points by dsr12 5y ago