3 ms·

GPU constraints. Time spent serving an API is time not spent training new models (for publishing or R&D).