8 ms·
Say_what: Using speech-to-text to fully check out during conference calls
- zaidf 10y agoBoggles my mind that gotomeeting doesn't have a feature to auto unmute when your name is mentioned.
- aggie 10y agoThat adds a ton of complexity and opportunity for embarrassing bugs/flaws while gaining only slight convenience. As a product manager I wouldn't touch that.
- zaidf 10y agoIt may not be the simplest feature to implement but I do think we have enough tech now to build a pretty solid feature around this. Also, I wouldn't call it merely a slight convenience when multiple times a day you see the pattern repeat of there being a long pause after you ask someone a question, followed by "sorry, I was on mute."
- mungoman2 10y agoVoice-chat used for gaming has had unmute on speech for more than a decade. That solves the problem of background humming, while getting all the voice tgrough.
- Phemist 10y agoNot usable for people named 'Mike'.
- zeroxfe 10y agoTurn up the echo cancellation, and you'll be fine.
- pizzasynthesis 10y ago'Mike' and 'mic' are homonyms. Methinks it a joke.
- troncheadle 10y agoor 'Will'
- transpy 10y agoI had this idea once and routed my laptop's output audio into its own microphone and then opened a Google text document and turned dictation on. It didn't work too well, because of: noise/signal ratio and the strong Indian accent of the speaker. With normal paced pronunciation and clean audio it works definitely better.
- adrianN 10y ago"How to get fired for sending audio of all you conference calls to IBM" Pretty fun hack though.
- cwilkes 10y agoNext post from IBM: "we trained our speech to text AI bot on your idiotic conference calls and it killed itself out of boredom"
- ianamartin 10y agoNext next post from IBM: Tay turned out to be good for something after all. It turns out that project meetings are a lot more fun when no one is talking and 8 people are channeling an angry, racist, 19-year-old girl.
- sbierwagen 10y agoTay was Microsoft, not IBM.
- Frank2312 10y agoEven if it's classified, there is no problem following yesterday.
- jandrese 10y agoThis is the high tech equivalent of drawing eyeballs on your eyelids so you can go to sleep during a meeting. I do kind of like the idea of dialing into a meeting but saying that you'll be AFK and then just reading the transcript afterward. It seems like it could be a real time saver in those cases where you're not really participating currently but want to keep up with the project.
- throwawayReply 10y agoOnce upon a time there were people called secretaries and things called minutes.
- StavrosK 10y ago> It seems like it could be a real time saver in those cases where you're not really participating currently but want to keep up with the project. Yep, very. Just imagine! "So, guys, the new feature we onion maybe needs to beat the liver by the twenty and. Josh, you we'll get the baby to Reese pony ability customer. Let me know if super busy ved communication."
- nickpsecurity 10y agoThat's whst I was thinking. Usually something important in a stream of filler at the meeting. Watch it be misinterpreted by the software while the filler is intact haha. Even worse, using machine learning that optimizes for common case might actually make it worse given signal to noise ratio.
- aantix 10y agoIf you do zone out and some one calls on you, you could use one of these tricks to appear smart in the meeting.. http://thecooperreview.com/10-tricks-appear-smart-meetings/ http://thecooperreview.com/10-tricks-appear-smart-meetings/
- FLUX-YOU 10y ago>Will it scale? >Yep The only reasonable answer to this question
- yoo1I 10y agoAnswer to what we're all thinking: > I do run the risk of losing credibility as to whether I'm actually listening in meetings now, but I'm not too concerned about that. I made this as a joke, and my coworkers know that http://www.businessinsider.com/josh-newlan-creates-say-what-to-tune-out-of-conference-calls-2016-5 http://www.businessinsider.com/josh-newlan-creates-say-what-...
- mistersquid 10y agoI think this answer--that Newlan's employer, Splunk, is in on the joke--is only a partial reason that Splunk tolerates Newlan writing and publishing "Say What?". From the "Readme.md": > Installation (OS X) > 1. Sign up for, install, and run Splunk Enterprise > ◦ This has to be enterprise; the HTTP Event Collector feature used here doesn't exist in light Kudos, to Splunk for having the guts to "allow" Newlan to unleash "Say What?" on conference calls everywhere, and cheers to Newlan for dreaming it up. EDIT: formatting, readability, punctuation.
- kevinschumacher 10y agoOh, he works for Splunk? My initial thought was, "who would choose Splunk for the datastore for anything?" This now makes sense. edit: by "anything", I mean "anything that isn't logs/security event data"
- gd2 10y agoI like it, but it also sounds so wrong. Nice hack project.
- ams6110 10y agoMost brilliant thing I've seen in some time. If it highlights the complete waste of time that almost all conference calls are, it would be a service to mankind.
- ClayM 10y agoNecessity may be the mother of invention, but laziness is it's apathetic dad. Kudos, sir. Kudos.
- ellisv 10y ago"… what do you think about that Josh?" "Sorry, I didn't realize my mic was on mute there." "No problem Josh, we can hear you now just fine." "Sorry, I didn't realize my mic was on mute there." "... um, Josh?" "Sorry, I didn't realize my mic was on mute there."
- klenwell 10y agoOr a conference call with a project manager (fully present) and 5 developers all using this. Perhaps a scene for Silicon Valley.
- gregmac 10y agoReminds me of "A Conference Call in Real Life" https://www.youtube.com/watch?v=DYu_bGbZiiQ https://www.youtube.com/watch?v=DYu_bGbZiiQ
- icebraining 10y agoMaybe they could play Lenny instead.
- baseten 10y agoHello, this is Lenny.
- tpowell 10y agoFerris Bueller would be proud.
- russdill 10y ago"Mike: Sorry I didn't realize my mic was on mute there"
- AstroJetson 10y agoVery nice, and I thought I was cool putting my end of video on freeze while I did other stuff during the conference.
- coleca 10y agoThis is genius. How long before instead of dialing into conference calls, we just send our bots and have bot to bot con-calls? Could this be the killer Twilio app?
- EGreg 10y agoAnd then they can run the company for us, as well. On fb we already have bots posting articles and people asking for a bot to deal with the deluge of articles. Bots posting for screener bots.
- JBiserkov 10y agoFrom yesterday: http://www.commitstrip.com/en/2016/07/05/bot-bot/ http://www.commitstrip.com/en/2016/07/05/bot-bot/
- misiti3780 10y ago`Could this be the killer Twilio app?` how so ?
- nitrogen 10y ago...by merging it with a bot that quotes a random sentence from any comment with "killer" and "app" in it, asks for free work from humans by saying, "How so?" (AKA nerd sniping) and submitting the results to a startup incubator automatically.
- tluyben2 10y agoI tried this a few weeks ago with Watson for that purpose (being able phase out during conference calls); complete gibberish came out on all my trials (about 40 conference calls) with 2,3,4,5 and 8 people, all in English. All come out complete garbage. You can't even guess what we are talking about reading the entire transcripts. Not sure if this is not just the same thing... If it is, I would love to hear your experiences. Edit: shame I didn't publish it :) Edit2: I had one call for which I have a colleague speaking who speaks 'the Queen's English' and same result...
- adrianN 10y agoYou know what they say, garbage in, garbage out.
- ldehaan 10y agowouldn't that just mean that Watson sucks at text to speech? also since that's probably the case for most tts services (at least in my experience) why not run the audio through all the tts engines you can find and compare results. keep what has the highest matches and see if you can get the other words using phonetics engines. for words that are specific to your company train a tts engine on those words and weight your local engine higher than other services. you can get a pretty decent translation back, but who would be so lazy as to work that hard..... ;)
- skykooler 10y agoA large part of the issue is that if you are dealing with phone meetings, audio is severely compressed, and not very similar to the training data that Watson has been taught with. Google Voice might be able to do a better transcription, because they have much more data from phone messages to work with, but eventually it comes down to the fact that voices over a phone line are a lot harder to understand without context processing than voices recorded with a decent microphone.
- caseysoftware 10y agoIt's how they've structured their audio for ASR. When you have a single track for all channels, the signals get garbled and it's hard to segment each out. The key is using a conference call system which captures each track separately. Polycom, Tropo, and others do it. Then when you run ASR, you can feed in each channel and have a "unified" transcript. And yes, I've worked on this problem at my last startup where we did all of that and took things further by adding search. Here's a demo: http://clarify.io/try-it-now/?id=20f5e8c4f1ef4f8c91160839b4815eb1 http://clarify.io/try-it-now/?id=20f5e8c4f1ef4f8c91160839b48...
- ascotan 10y agoI approve of this. Gold star to this man.
- kh_hk 10y agoKind of related, I did something similar (as in purpose) for slack [1]. It can be used to set yourself away or... well, it can respond a canned message as you. It also disables the annoying auto-away after 30min. You can even close slack and let it send you system notifications for incoming mentions. Heck, you could even run it on a server and pretend to be you whilst you sip mojitos on a beach. [1]: https://github.com/eskerda/slack-keep-presence https://github.com/eskerda/slack-keep-presence
- douche 10y agoI wonder if I can hire an intern or something to just transcribe all conference calls? Actually having a record of what was said would be lovely - too often audio is just too ephemeral and goes poof, with nobody remembering what was agreed upon. It's got to be worth $10-15/hour in wasted time and recapping.
- whacker 10y agoI think a note taker taking live notes that everyone can see, and perhaps edit, is a great way to record meetings. As a bonus, you even have something tangible to show the time you put in!
- clockwerx 10y agoI tend to live tweet stuff into slack, makes it useful to dump into other tools or get input from others who arent there, eliminates a lot of status update / meeting recaps
- skoocda 10y agoI'm working on this at the moment, in a way that also uses the edited transcripts to train our ASR system to perform better for later sessions. The difficult part is the speaker diarization, however. Multiple people talking at once requires some intricate signal processing to sort out.
- zomg 10y agomy solution: don't go to meetings where you don't/can't/want to pay attention. what a waste of time.
- teen 10y agoI know it a joke and all but you're not supposed to record people without their consent, and I think this would qualify.
- VonGuard 10y agoI just want this as a call transcription service.... Good ones are hard to find.
- sr_banksy 10y agoTry steno: https://s10o.com https://s10o.com
- delazeur 10y agoObviously there is the potential for certain forms of abuse here, but it could be really useful for creating a record of what was said and what promises were made on the call. "Oh, you thought it was due on Monday? Nope, transcript says you promised it by close of business Friday."
- srtjstjsj 10y agoDisclosure: This is an astroturf ad for the author's employer. It's a funny gimmick, for entertainment and to get visibility for the author's employer's name.
- arrowoftime 10y agoOr just use this: http://docs.gridspace.com/ http://docs.gridspace.com/
- jakobegger 10y agoPretty amazing. Makes me wonder what the current state of the art in general purpose voice recognition is. I recently wondered if there is a a video-chat app that uses voice recognition for live subtitles? Would be awesome for talking to people who don't have perfect hearing. Could this be hacked together in a similar way?
- skoocda 10y agoI'm working on it, making more of a general purpose API for speech recognition to plug in during Hangouts calls, twitch streams, or any pre-recorded media. Called Spreza
- skoocda 10y ago* I should clarify as well, for your first question. State of the art is generally either IBM's 2016 English Conversational Telephone Speech Recognition System [0], or Baidu's DeepSpeech2 [1]. IBM's is a little more complex, but I'd actually argue Baidu is more promising due to the robust ability to learn new languages. 0: arxiv.org/abs/1604.08242 1: arxiv.org/abs/1512.02595
- jakobegger 10y agoThanks, this looks interesting!