I am not sure about that! It seems like small models are emerging that are a bit more specific but can be very small, and thus have much lower latency. For exam

I am not sure about that! It seems like small models are emerging that are a bit more specific but can be very small, and thus have much lower latency. For example: https://arxiv.org/abs/2305.07759 https://arxiv.org/abs/2305.07759