3 ms·
Even in Australia is the LLM lag to a server noticable? Generally an LLM seems to take about 3s or more to respond, and the network delay to the US is a couple
by EarthMephit 2y ago
Even in Australia is the LLM lag to a server noticable?
Generally an LLM seems to take about 3s or more to respond, and the network delay to the US is a couple of hundred milliseconds.
The network delay seems minimal compared to the actual delay of the LLM.