3 ms·Our p99 for gpt4 is 3s. Images take up to 50s.by itake 3y agoOur p99 for gpt4 is 3s. Images take up to 50s.spxneo 3y agoso how would you go about improving that?freediver 3y agoNot using an LLM for it.itake 3y agowe only send 0.5-5% of traffic to gpt4, thanks to smaller faster cheaper models. So not all of our traffic is hit with 50s latencies :-/