3 ms·
It doesn't work like that, but it can. Latency would be fine for inference, this is low earth orbit, that is about 25ms optimistically. Well within what we exp
by fooker 9mo ago
It doesn't work like that, but it can.
Latency would be fine for inference, this is low earth orbit, that is about 25ms optimistically. Well within what we expect from our current crop of non local LLMs.