3 ms·

I don’t think so. The reason why Cerebras is so fast for inference is that the KV cache sits in the SRAM.