3 ms·
Your marketing says 500 but your math says 759.
by az226 2y ago
Your marketing says 500 but your math says 759.
- dietr1ch 2y agoThat's called marketing
- vr000m 2y agoThe latencies in the table are based on heuristics or averages that we’ve observed. However, in reality, based on the conversation, some of the larger latency components can be much lower.
- whizzter 2y ago500 are the transcription/llm/tts steps (ie the response time from data arriving on the server to sending back), the rest seems to be various non-AI "overheads" such as encoding, network traffic,etc.
- vessenes 2y agoMy tests had one outlier at 1400ms, and ten or so between 400-500ms. I think the marketing numbers were fair.