4 ms·
Good article and I agree with everything in there. For my own voice agent I decided to make him PTT by default as the problems of the model accurately guessing
by nowittyusername 8mo ago
Good article and I agree with everything in there. For my own voice agent I decided to make him PTT by default as the problems of the model accurately guessing the end of utterance are just too great. I think it can be solved in the future but, I haven't seen a really good example of it being done with modern day tech including this labs. Fundamentally it all comes down to the fact that different humans have different ways of speaking, and the human listening to them updates their own internal model of the speech pattern. Adjusting their own model after a couple of interactions and arriving at the proper way of speaking with said person. Something very similar will need to be done and at very fast latency's for it to succeed in the audio ml world. But I don't think we have anything like that yet. It seems currently best you can do is tune the model on a generic speech pattern that you expect to fit over a larger percentage of the human population and that's about the best you can do, anyone who falls outside of that will feel the pain of getting interrupted every time.
- KurSix 8mo agoIt feels like this is one of those areas where the last 10% of polish will take 90% of the effort
- x_may 8mo agoThe 80/20 rule always wins
- spuz 8mo agoCheck out Sparrow-0. The demo shows an impressive ability to predict when the speaker has finished talking: https://www.tavus.io/post/sparrow-0-advancing-conversational-responsiveness-in-video-agents-with-transformer-based-turn-taking https://www.tavus.io/post/sparrow-0-advancing-conversational...
- nowittyusername 8mo agoThanks, ill read it now.