4 ms·What latency? How much is it compared to LLM inference speed?by stingraycharles 8mo agoWhat latency? How much is it compared to LLM inference speed?storus 8mo agoSee the Redpanda comment/link here.