4 ms·
Too many people equate speech to text as 'speech recognition' and it clearly isn't. What is not a solved problem is Natural Language Processing. That NLP isn't
by ChuckMcM 9y ago
Too many people equate speech to text as 'speech recognition' and it clearly isn't. What is not a solved problem is Natural Language Processing. That NLP isn't solved, is a fertile source of papers. What is 'kinda' solved is the voice CLI, that is where speech is converted to text, that text is inserted in a class command interpreter, and if recognized the command is executed, otherwise it isn't.
Nobody expects to be able to type 'find me the files that changed yesterday' into a computer shell and have it do something sensible. But 'find ./ -type -f -mtime yesterday' sure we can expect that to work. Getting from the first one to the second one requires something called an ontology.
I worked on a team at IBM that was building this sort of capability. The plan was that in conjunction with an excellent tool kit for disassembling a sentence into its component parts (verbs, nouns, adjectives etc) and then matching the elements recognized with an onotology associated with that action. 'find' being the verb would select the search action ontology, 'files' as an object of the verb would select the computer files object ontology, and then 'changed' and 'yesterday' would match 'modification' in that ontology and 'yesterday' would match one of the two sub children of 'modification' (time and change-actor). Then you would go back with what was the compiler equivalent of an abstract syntax tree which the 'command generator' would use to emit the necessary command actions and flags.
I have no idea why they cancelled it. It was an inscrutable place to work at in many ways :-).
- gok 9y ago"Speech Recognition" is an accepted term of art for "speech to text" or "transcription." "Speech Understanding" is a related but different problem.
- astrodust 9y agoI'd challenge you to transcribe a casual conversation without understanding. Too many words sound very similar, if not identical, and the context of the conversation dictates which word is in play. Even something simple like "They're unhappy, Ness" could be interpreted as "Their unhappiness" unless you know Ness is a person in the converation.
- gok 9y agoThat's like saying because "O" and "0" have the same shape that we can't solve OCR without general AI. A modern statistical speech recognition system has no trouble determining that "they're unhappy, ness" is a dramatically less likely word sequence than "their unhappiness". edit: I read your example backwards, but still, a statistical system can easily incorporate contextual words without actually understanding what they mean. Names from the speaker's contacts in particular are widely used in ASR systems for this reason.
- deleted 9y ago[deleted]
- astrodust 9y agoThat's because it doesn't care, it just goes for the most statistically probable phrasing in a general conversation, not the one you're actually having. As for the OCR problem, try writing one for Chinese calligraphy and get back to me on if context is important or not.
- gok 9y agoContext is certainly extremely important, but a model can incorporates context without general understanding.
- com2kid 9y ago> Nobody expects to be able to type 'find me the files that changed yesterday' Google Photos is pretty close. "photos from december" works fine. "Find photos from decemeber" doesn't. I can type in "effects photos" and find photos Google applied effects to, which is pretty nifty. It is probably equivalent to the old game parsers in intelligence, but for a given domain it works pretty well. They could stand to filter out a lot more words, but it works OK in general. If I type in "photos with a blue sky" it knows to drop "photos with a", photos presumably being redundant on photos.google.com!
- ChuckMcM 9y agoThe query parser we had Blekko could do this as well. It could process 'photos' and 'december' as keywords and use them in a search. It would fail on 'photos last month' for the reasons I mentioned (it didn't really know december was a date it just looked for it to show up in the description or metadata) That said, Google has done some great stuff in inferring things like units for conversion 10 feet in inches is easily parsed for example as a conversion request.
- probably_wrong 9y ago> I have no idea why they cancelled it. My guess: because statistical methods are all the rage now, and have been for a while. This is famously illustrated by Fred Jelinek's quote "every time I fire a linguist, the performance of the speech recognizer goes up"[1], and cemented with the success of Google Translate. [1] https://en.m.wikipedia.org/wiki/Frederick_Jelinek https://en.m.wikipedia.org/wiki/Frederick_Jelinek
- astrodust 9y agoI fully expect to be able to type (or say!) "find me the files that changed yesterday, sort by modification time, and display the first five images in that set". The biggest failing of things like Siri and Cortana is they're not conversational, they're really not good at learning from example, they can only respond in hard-wired ways. "What's the weather?" will work. "Do I need a jacket tomorrow?" won't because they don't understand, instead giving the closest answer they can based on available information, not knowing how you prefer to dress or what you think is cold. Until we can have full feedback neural networks we're not fully capitalizing on this AI stuff. Once we can cut the retraining time down to something marginal, maybe we can have computers "dream" and self-reprocess based on their accumulated learnings instead of waiting for a new kernel from the cloud.
- adrianbg 9y agoSpeech to text is exactly speech recognition. Speech to text isn't solved.