6 ms·
Not particularly. Speech to text is mostly solved at this point. When constrained to a small set of domains, so is intent recognition and canonicalization. That
by joshuamorton 9y ago
Not particularly. Speech to text is mostly solved at this point. When constrained to a small set of domains, so is intent recognition and canonicalization. That's certainly the hardest part, but we are still able to do it within specific domains.
Once you have a canonical request, response has been solved for a while. really I think it's more likely that you consider the problems where you understand how one would debug to be simpler ;)
- scarface74 9y agoIs it solved for various accents? really I think it's more likely that you consider the problems where you understand how one would debug to be simpler ;) Fair point. But I do have a little experience with natural language processing. My corpus was this at level 1. https://www.newsinlevels.com https://www.newsinlevels.com
- joshuamorton 9y agoWhen you restrain things to a specific domain, yes. Essentially if you know that the conversation will be about restaurant booking, and you only hear S_____r___zed th___ay, you can reconstruct sorry we are closed Thursday with a decent level of confidence. So short of being entirely gibberish, yes.
- p1esk 9y agoHow can you constrain it to a specific domain if I just want to to dictate a text message to someone? That task is far from solved.
- scarface74 9y agoIn the context of Google Duplex, I'm almost willing to give them the benefit of a doubt. Understanding text well enough to parse intent is relatively easy once you narrow the domain to making appointments. It doesn't take sophisticated AI just a lot of data and a standard rules engine. Even parroting back text answers in a limited domain is easy to do and make it sound human. When I say "relatively easy", I don't mean "some guy in his basement". I mean a bunch of capable developers. What I'm not convinced about is that speech to text is good enough once you take into consideration accents even within a limited domain. Especially when the person on the other end doesn't know they are speaking to a computer and are not going out of their way to speak clearly and simply.
- p1esk 8y agoI don't know much about Google Duplex, but recently I had to do the following: call all dentists in 20 mile radius, and make an appointment if they can: 1. treat a 3 year old kid 2. accept insurance xxx 3. see us within 5 days, preferably at 9am. Out of all which meet all these criteria, pick the soonest available appointment, if multiple available on the same day, pick the closest one. How should I explain all this to Google Duplex? How can I make sure it understood me? What exactly is it going to say to the appointment desk person? How can I verify it made the correct appointment? Would it need to make all the appointments first, then cancel all but one?
- scarface74 8y agoI would hope that Google would be smart enough not to include medical appointments as part of its domain. They shouldn't want to go anywhere near the liability of processing a call that falls under HIPAA and the liability of getting it wrong.
- jcims 8y agoIt could just ask the questions and send the user the short list to work from.
- jacquesm 8y ago"we thought about coming Thursday but then you are closed so now we thought of Saturday".
- joshuamorton 8y agoThe important thing is that you have timing information and can more or less accurately count phonemes/syllables even if you can't identify them. So the sentence you suggest couldn't fit in the space I suggested.
- realusername 9y ago> Not particularly. Speech to text is mostly solved at this point There's still no software capable to understand me properly in French right now, speech to text sill has a long way to go.
- megaman22 8y agoIs that just a question of expending the resources on that domain, though? Untold man-hours and compute cycles have been spent on making English speech-to-text mostly work. I would be surprised if even a fraction of that energy has been devoted to other languages.
- YeGoblynQueenne 8y agoLet's say we have a set of techniques that can do convincing text-to-speech in limited domains, but those techniques are too cumbersome to solve it in the general sense, at least with current equipment and data. Then there's the ability of humans to process speech, which works in a much broader range of situations and therefore suggests that there is a better way to do that sort of thing than the techniques we have right now. Does this help reconcile the two seemingly contradictory comments, above?
- realusername 8y agoThe issue with French and why it works so badly is the assumptions people made when designing the speech-to-text by starting from English. The core issue is that spoken French and written French are two completely and widely separate languages, with a much much greater difference than English. So the current approach to try to use books and mapping words to them isn't just working well. What I mean is the current approach is pretty limited.
- dpark 8y ago> The core issue is that spoken French and written French are two completely and widely separate languages In what way?
- TeMPOraL 8y ago> Speech to text is mostly solved at this point. Might be expecting too much from our market economy, but I wouldn't call it solved until it can be done locally, without engaging third party machines in the cloud. (Ironically, voice recognition was working locally in the past, with quite decent accuracy. Then it got superseded with cloud solutions.)
- red75prime 8y ago> with quite decent accuracy Citation needed. I've tried commercially available systems about 15 years ago, and the results were universally awful.
- scarface74 8y agoIt's the limited domain that I can see making it feasible. I'm not convinced how well it will work with accents.
- dwaltrip 8y ago>> Making a chatbot that can understand the variety of human speech, translate it to text, understand it and respond intelligently > Speech to text is mostly solved at this point. You are talking about mapping sound patterns to words. The parent is talking about understanding what the words actually mean. Those are very, very different things. We are nowhere near having a computer program that actually understands arbitrary language anywhere close to a human level. Duplex is a clear example of how far we have to go. They struggle to build a program that can operate effectively in a single, incredibly constrained domain.
- joshuamorton 8y agoWe are when you constrain the domain, which is what I said.
- deleted 8y ago[deleted]