4 ms·

Beam search can be optimized incredibly aggressively on hardware. Check out finite state transducers.