3 ms·so how would you go about improving that?by spxneo 3y agoso how would you go about improving that?freediver 3y agoNot using an LLM for it.itake 3y agowe only send 0.5-5% of traffic to gpt4, thanks to smaller faster cheaper models. So not all of our traffic is hit with 50s latencies :-/