3 ms·
* when you have a good internet connection ** when you live in the USA
by jonplackett 2y ago
* when you have a good internet connection
** when you live in the USA
- whimsicalism 2y ago> * when you have a good internet connection Or at least, a good enough internet connection to send plaintext. > * when you live in the USA Even from Australia to USA is just ~300ms of latency for first token and then the whole thing can finish in ~1s. And making that faster doesn't require on-device deployment, it just requires a server in Australia - which is obviously going to be coming if it hasn't already for many providers.