5 ms·
That's very technically impressive, but 6% is still a long way from where it needs to be as anything like a primary interface. Even 1% is pretty high when you c
by M_Grey 10y ago
That's very technically impressive, but 6% is still a long way from where it needs to be as anything like a primary interface. Even 1% is pretty high when you consider how many words you can utter in a few minutes, and how many errors that would generate.
Edit: For comparison:
http://www.utdallas.edu/~assmann/hcs6367/lippmann97.pdf http://www.utdallas.edu/~assmann/hcs6367/lippmann97.pdf
- mintplant 10y agoHow does it compare to the typical human error rate?
- M_Grey 10y agoBest I can find is section four here: http://www.utdallas.edu/~assmann/hcs6367/lippmann97.pdf http://www.utdallas.edu/~assmann/hcs6367/lippmann97.pdf It seems to be significantly less than 1% - 1.6%
- funkymike 10y agoRecognizing the words is just the first step. Getting meaning out of those words is what really counts. When on a telephone call I may miss a percentage of what was said, due to poor audio quality, the speaker's accent, etc., but based on context I can still understand the message the speaker is trying to convey most of the time. Transcribing each word with near-perfect accuracy is unnecessary if the layers above that can handle it.
- M_Grey 10y agoThat's true, but I wonder if computers will exceed out technical accuracy first, or begin to actually "understand" things first? I suspect the former.
- icebraining 10y agoThey don't need to actually understand - whatever that means - they can apply statistical models based on phonetic distances and large corpora of dialogue.
- M_Grey 10y agoHas that worked so far?
- copperx 10y agoOf course it has. We went down from 40% to 6.9% error rate in 26 years. It may take a couple of decades to get to 0.1%.
- Fricken 10y agoGoogle voice search will make several guesses as to what I said. It will sometimes enter a nonsensical, but similar sounding phrase to what I intended into the text box, but will then figure out that it's first guess is nonsense and return the correct search result. So just based on observation I would say it works pretty good. On mobile I almost always use voice search, and unless I'm searching for an italian name or something weird it almost always hears me correctly. Even in a noisy pub.
- M_Grey 10y agoThat's a good point, I've rarely had issues with Google voice searching.
- pesenti 10y agoThe human error rate on this task is 4% (https://pdfs.semanticscholar.org/387e/7349b8e31e316c2a7380603d1b6c0b1417c8.pdf https://pdfs.semanticscholar.org/387e/7349b8e31e316c2a738060...). So you are basically saying that telephones are a useless interface... What is amazing is how consistently people overestimate human performance.
- Swizec 10y agoCompared to voice over internet? Yeah, it's pretty terrible.
- M_Grey 10y agohttp://www.utdallas.edu/~assmann/hcs6367/lippmann97.pdf http://www.utdallas.edu/~assmann/hcs6367/lippmann97.pdf I did say "primary interface" as well, which definitely rules out a mediocre phone connection.
- contextfree 10y agoDoes using speech multimodally with other input methods (touch, gesture, pen, clicker, game controller, even keyboard - may seem silly but speech is potentially faster at some tasks) still count as "primary" if the other input method is used supplementarily to help disambiguate?
- M_Grey 10y agoI'd say, and let be clear that I know and accept this to be a relatively arbitrary distinction on my part, that for an input to be "primary" it needs to be able to stand alone (touchscreen input, keyboard and mouse, etc). That's not to say that it must stand alone, but that when all other options are off the table, that would be your preferred method for text/data entry. That's a troublesome definition though at least in part for reasons you've brought up or alluded to, which is that a multimodal approach is pretty clearly going to dominate. That said, speech recognition at least stands to replace the keyboard for say, the author of a book or article, if it's good enough.
- 10y ago