5 ms·

I control my browser (actually my whole computer) with my voice. I'm not aware of anything specific where you could say "click publish" and it would intelligen

by SCdF 3y ago

I control my browser (actually my whole computer) with my voice. I'm not aware of anything specific where you could say "click publish" and it would intelligently find the published button, though I haven't looked. What I use is a combination of vimium (a vim browser plugin, there are a few) and talon (https://talonvoice.com/ https://talonvoice.com/), either just relying on the vim shortcuts but with my voice, of for specific domains making talon shortcuts. I have also heard good things about Rango, which is supposed to be a vimium like thing but much more voice focused: https://github.com/david-tejada/rango https://github.com/david-tejada/rango. I haven't tried to use it though.

Karunamon 3y ago
Dragon (dictate/NaturallySpeaking/professional/whatever they are calling it this year) has the ability to do this in conjunction with their official browser add-on, but it is an absolutely miserable product otherwise and I would not recommend it. I can say the words "click reply" and this message will be sent.
- rickydroll 3y ago
  as a multi-decade user of the various forms of Dragon, it's not a miserable product. The company is a bunch of ass holes now owned by another bunch of ass holes. But for day-to-day use, it's not bad assuming a Windows environment doesn't mess with it. Most people go south with Dragon when they expect to be of the speak the keyboard or expected to be a perfect transcription. The reality is, it's like dictating to a good typist with a little bit of hearing problems. And like this hypothetical typist, you get worse results if you yell at it. From what I can tell, Dragon, and I suspect most other speech recognition environments work best if you use them for dictating text and have enough commands supporting text editing. Dragon did a good job with what used to be called "Select-and-Say". It was a form of editing that worked with speech model and not some bastard grammar hack Forcing the editors keystroke commands to do a given job.
  - Karunamon 3y ago
    On the contrary, my issues with Dragon are not surrounding its recognition accuracy (though I would kill to be able to hook it up to whisper), but literally everything else. - Running the accuracy tuning tool more than once actually degrades accuracy - User profiles will degrade over time, necessitating a export/new profile/import process every few months or else the accuracy becomes unacceptable - Does not work with electron applications that apparently fucking everything has to be nowadays - The browser plug-in… Dear God. It outright does not function properly on many top websites (Text input on twitter and twitch come to mind immediately), and it occasionally causes Dragon to slow down to an infuriating degree. Sometimes it actually causes certain sites to break! - Unstable. Crashes to desktop a couple of times per week, and leaves some appendage running in such a way that it can't be directly restarted. I had to write a PowerShell script (https://gist.github.com/Karunamon/f2b684d083fc341ee79aab1fb29cf3c5 https://gist.github.com/Karunamon/f2b684d083fc341ee79aab1fb2...) and put it on my start menu to deal with this.
    - rickydroll 3y ago
      these are all very good points, very accurate and a common experience. 1) anyone who knows anything never runs accuracy tuning tool. 2) apparently user profile degrading is greatly reduced in version 16. Don't really know because I haven't migrated yet. 3) electron is a flocking abomination. I blame JavaScript and the HTML Dom. 4) I would not entirely blame the browser plug-ins. There is a boatload of JavaScript out there that does everything it can to fark up dragons need to look into a text area so can decide how to make things work. 5) that sounds more like a Windows, may be hardware problem. I haven't had a Dragon related crash (15.61) for more than a couple of years. Windows is a piece of shit but it's crash rate is also dropped. re: wisper oh I would love to have a good whisper environment on Linux that's a reasonable approximation of Dragon. What that means is ability to dictate into any window anywhere, the ability to edit the content in the window, and an extension that lets you add a grammar for commands (preferably based on Python) then I would be able to ditch Windows and tell Nuance to fark off

by SCdF 3y ago

Karunamon 3y ago

Dragon (dictate/NaturallySpeaking/professional/whatever they are calling it this year) has the ability to do this in conjunction with their official browser add-on, but it is an absolutely miserable product otherwise and I would not recommend it. I can say the words "click reply" and this message will be sent.

rickydroll 3y ago
as a multi-decade user of the various forms of Dragon, it's not a miserable product. The company is a bunch of ass holes now owned by another bunch of ass holes. But for day-to-day use, it's not bad assuming a Windows environment doesn't mess with it. Most people go south with Dragon when they expect to be of the speak the keyboard or expected to be a perfect transcription. The reality is, it's like dictating to a good typist with a little bit of hearing problems. And like this hypothetical typist, you get worse results if you yell at it. From what I can tell, Dragon, and I suspect most other speech recognition environments work best if you use them for dictating text and have enough commands supporting text editing. Dragon did a good job with what used to be called "Select-and-Say". It was a form of editing that worked with speech model and not some bastard grammar hack Forcing the editors keystroke commands to do a given job.
- Karunamon 3y ago
  On the contrary, my issues with Dragon are not surrounding its recognition accuracy (though I would kill to be able to hook it up to whisper), but literally everything else. - Running the accuracy tuning tool more than once actually degrades accuracy - User profiles will degrade over time, necessitating a export/new profile/import process every few months or else the accuracy becomes unacceptable - Does not work with electron applications that apparently fucking everything has to be nowadays - The browser plug-in… Dear God. It outright does not function properly on many top websites (Text input on twitter and twitch come to mind immediately), and it occasionally causes Dragon to slow down to an infuriating degree. Sometimes it actually causes certain sites to break! - Unstable. Crashes to desktop a couple of times per week, and leaves some appendage running in such a way that it can't be directly restarted. I had to write a PowerShell script (https://gist.github.com/Karunamon/f2b684d083fc341ee79aab1fb29cf3c5 https://gist.github.com/Karunamon/f2b684d083fc341ee79aab1fb2...) and put it on my start menu to deal with this.
  - rickydroll 3y ago
    these are all very good points, very accurate and a common experience. 1) anyone who knows anything never runs accuracy tuning tool. 2) apparently user profile degrading is greatly reduced in version 16. Don't really know because I haven't migrated yet. 3) electron is a flocking abomination. I blame JavaScript and the HTML Dom. 4) I would not entirely blame the browser plug-ins. There is a boatload of JavaScript out there that does everything it can to fark up dragons need to look into a text area so can decide how to make things work. 5) that sounds more like a Windows, may be hardware problem. I haven't had a Dragon related crash (15.61) for more than a couple of years. Windows is a piece of shit but it's crash rate is also dropped. re: wisper oh I would love to have a good whisper environment on Linux that's a reasonable approximation of Dragon. What that means is ability to dictate into any window anywhere, the ability to edit the content in the window, and an extension that lets you add a grammar for commands (preferably based on Python) then I would be able to ditch Windows and tell Nuance to fark off