4 ms·Surely ping time is basically irrelevant dealing with LLMs? It has to be dwarfed by inference time.by bigfudge 2y agoSurely ping time is basically irrelevant dealing with LLMs? It has to be dwarfed by inference time.