4 ms·I imagine you have to start decoding many speculative completions in parallel to have true low latency.by whimsicalism 11mo agoI imagine you have to start decoding many speculative completions in parallel to have true low latency.