4 ms·
So you could just locally generate the "You're absolutely right! ..." prefix without even waiting for the response to stream in!
by HarHarVeryFunny 6mo ago
So you could just locally generate the "You're absolutely right! ..." prefix without even waiting for the response to stream in!
- 6510 6mo agoDo speech to text on the client and send the text/subtitles along with the audio. If the connection is truly bad, upload your voice and quantify emotional payload.
- HarHarVeryFunny 6mo agoI guess different approaches could be applicable for client to server vs server to client. For client to server you want low latency, don't care about pauses introduced by communications (the model doesn't care), and could certainly tolerate a fallback to lower bandwidth text only (local SST) or more heavily compressed voice. For server to client it needs to be high quality voice without pauses, but as the parent was suggesting you could potentially hide response latency (whether due to server or communication degradation) by using a human-like conversational "trick" of at least making some sound before brain is engaged and generating a response. "That's absolutely right! ..." would be a tad annoying, but "Hmm..." might be OK, especially if not done all the time, just as a locally initiated conversational filler when the server is slow to respond.
- 6510 6mo agoHarHar, that makes me think of those people who start each sentence with your name.
- HarHarVeryFunny 6mo ago:) I guess that'd work too if they want to go with the Butt-Head persona!
- regularfry 6mo agoI do wonder if you actually need two models here. Audio-to-audio hindbrain on the client, and a beefy text-mode frontal lobe somewhere in the cloud, with the comms between them explicitly trained in as a potentially low-bandwidth steering connection transferring embeddings, not text.
- 6510 6mo agohttps://en.wikipedia.org/wiki/Sloot_Digital_Coding_System https://en.wikipedia.org/wiki/Sloot_Digital_Coding_System