Could you expand on that a little? Are you mostly fighting with high latency for deep learning models for imaging/audio or for traditional ML models on tabular

Could you expand on that a little? Are you mostly fighting with high latency for deep learning models for imaging/audio or for traditional ML models on tabular data too? What sorts of latency SLAs do you aim for? (I do some work in this area and am always interested to hear war stories of inference issues.) Thanks!