2 ms·
The latency was in constructing the 'prompt' string (via his custom program). The actual input latency in the stack is both 'constant' and rather difficult for
by mjevans 9y ago
The latency was in constructing the 'prompt' string (via his custom program). The actual input latency in the stack is both 'constant' and rather difficult for an end user to directly affect. Thankfully the millions of human-hours put in to the hardware and software stack have made that quite efficient.
- majewsky 9y ago> The actual input latency in the stack is both 'constant' and rather difficult for an end user to directly affect. The article starts with a link to https://danluu.com/term-latency/ https://danluu.com/term-latency/, which disproves both assertions.