2 ms·
> * when you have a good internet connection Or at least, a good enough internet connection to send plaintext. > * when you live in the USA Even from Austral
by whimsicalism 3y ago
> * when you have a good internet connection
Or at least, a good enough internet connection to send plaintext.
> * when you live in the USA
Even from Australia to USA is just ~300ms of latency for first token and then the whole thing can finish in ~1s. And making that faster doesn't require on-device deployment, it just requires a server in Australia - which is obviously going to be coming if it hasn't already for many providers.