5 ms·

Deaf and following the World Cup? We're streaming live captions

143 points by sunpazed 12y ago

vomitcuddle 12y ago
Not a big fan of soccer, but this is really cool!
- zetx 12y ago
  They have other TV programs being streamed as well. Looks like 6 channels. (Ex: http://beta.tveeder.com/560/live http://beta.tveeder.com/560/live )
  - sunpazed 12y ago
    Yes - there's 6 streaming, see: http://tveeder.tumblr.com/post/60161190670/weve-just-graduated-from-alpha-to-beta-with-the http://tveeder.tumblr.com/post/60161190670/weve-just-graduat... The architecture allows for additional channels as needed.
    - sebastianavina 12y ago
      This could be the next big thing on the hipster world... - What are you doing? - Just here, reading TV
GFischer 12y ago
Very nice :) . Are these captions taken from a live text commentary (like BBC's service), or from a radio commentary? I think the second would be more useful, since they tend to mention players and plays more often. A nice case of tech helping people with disabilities, great job and good luck !
- goatforce5 12y ago
  The linked posting (now?) says the captions are coming from SBS Australia.
  - GFischer 12y ago
    Yes, it did when I read the posting, but is that live audio commentary transcribed or live text commentary? I think realtime-transcribed live audio commentary would be more timely and lively :) though also harder to do I guess. In either case it's a great service. Edit: it apparently IS computer-generated live audio! Amazing :) There are some syncing services between radio and streaming - for example here in Uruguay we like the local radio commentary, and so do the Brazilians and Argentineans, we might watch a match on tv with the sound turned off and radio turned on.
    - newscasta 12y ago
      Probably too late now that the conversation has moved on, but if you happen to see this could you point me to one of these syncing services? A very quick google search didn't turn up anything. Thanks.
- dean_cognation 12y ago
  curious how you are handling the copyright issues?.,..... or just hoping they don't notice?
parfe 12y ago
I don't understand the service. When watching tv with my hearing impaired father I push the CC button. For the world cup specifically the espn announcers perform so terribly we likely won't even do that and have music playing instead.
- carlob 12y ago
  I remember watching a match during a strike of announcers in Italy, where announcers are supposedly very knowledgeable about soccer. It was one of my best experiences in soccer ever, beat only by when I started using my radio to listen to a group of comedians commentary.
- roberthahn 12y ago
  Not all tv programmes are captioned. Sometimes pushing the CC button won't work :-) Then something like this becomes incredibly useful. EDIT: Also, (and I'm not sure if tveeder supports this) but making this a web service means that even hearing people can search for the resulting transcripts as easily as any other text.
roberthahn 12y ago
I wish I could upvote this a hundred times. This is exactly the kind of thing I like to see more of. Is this your project, sunpazed? Nicely done! EDIT: Wait, what? Did that guy really say: "Yes. It's edgy stuff, this. It will ruffle a few ferts. Will say something some people won't like. Hopefully they won't be watching the show. It wasn't very difficult to give Tony Abbott a dick and balls. He was holding this at the time." I spotted some other weird bits, (I have nothing to compare it to) Is this is computer-based voice recognition? I have to admit it's a lot better than Youtube's terrible excuse for captioning - most of what I see on this page looks pretty coherent and on topic.
- sunpazed 12y ago
  Yes, it is. Myself, and a small group of enthusiasts developed the service. We launched in 2011, with the idea that the hearing impaired could use the service to access a great source of realtime information - television. The hearing impaired could now objectively access and review online the quality of captions delivered by broadcasters. Since then, it has grown into a useful resource for everyone. One of the biggest benefits, we believe, is that our service raises the awareness of captioning to others who haven’t traditionally relied on it. For those technically minded, it's a client-server model built with custom client hardware. Currently, we're only streaming Australian channels, however, there's scope to plug in any terrestrial broadcast, and feed it into TVeeder. There's a REST API too.
  - roberthahn 12y ago
    That's pretty awesome. Thank you for stepping up to work on this.
  - GFischer 12y ago
    Thanks for the clarification, that's more what Hacker News readers want to know :) . I wish you best of luck and congratulations.
  - nivertech 12y ago
    what about Streaming API?
hellbreakslose 12y ago
Hmm ok nice idea but i think BBC is already having that functionability ... livetime game commentating.
vermontdevil 12y ago
I'm deaf and many many thanks for this. I will share with others.
rblatz 12y ago
Yesterday when I brought up ESPN's streaming feed they had an option to stream a video with closed captioning. Is this your source?
brassattax 12y ago
Do you have a way for people around the world to provide additional content? For example if I have a tuner card, and want to run some service to extract screenshots and CC text to send to you via some sort of API
- sunpazed 12y ago
  Yes. However, it does require custom hardware. We've prototyped a small hardware platform to allow others to contribute to the live feed. However, this remains at prototype stage - we've been running self funded since inception.
jcfrei 12y ago
Hmm, the stream doesnt load for me at the moment. Is it location restricted or are there too many users right now? The other streams work.
joeyspn 12y ago
Well done sir! There's so much talk about UX lately and still just few really think about real problems like Accessibility
robinhowlett 12y ago
Very well done. I experimented once with Sports broadcast captioning (not real-time though; using YouTube videos) by using Amazon Mechanical Turk for crowdsourced closed-captioning. An example is here: https://www.youtube.com/watch?v=MCgc1jAXGSk https://www.youtube.com/watch?v=MCgc1jAXGSk
eliben 12y ago
This is a very nice service - well done. Tangentially, most soccer commentary (esp. in the US) is so horrible it's not a big loss not being able to hear. Just watch the game ;-)
bhandziuk 12y ago
Isn't being deaf and watching soccer more like being there in person? Whenever I go see live matches there is no announcer. The ref has no mic and makes no hand gestures and there are no jumbo-tron close ups on anything important. Very difficult but apparently genuine. Part of the barrier to entry for football fans I suppose.
- dragonwriter 12y ago
  > The ref has no mic and makes no hand gestures While, from the stands, they may be difficult to see, soccer referees definitely make standardized hand signals.
  - bhandziuk 12y ago
    Is it only done the instant they make the call or is it repeated after the fat like in american football/hockey? I'll have to take your word for it because from where I've sat I could see nothing :)
    - gamegoblin 12y ago
      Main ones off the top of my head: Arm straight up: offside Arm towards goal line: goal kick Arm towards corner: corner kick Arm in one direction or the other indicates throw in direction (if it was a close call -- often there isn't any chance for dispute and the team knows what's what and throws it in within a second or two if there is a hurry). There is a "play on" type arm wave (usually accompanied by a verbal "play on" or something) to indicate "yes I saw him fall, no I don't think it's a foul, keep playing". The line referees have flags and have similar signals. The only real difference is for a foul they hold the flag straight up and wave it a little. For offside they hold it straight up and stand still to mark where the offside occurred. The line referee should always be located at the exact line that marks offside. Of course pro players are faster than referees, but to get past level 7 refereeing (starts at level 9, kids games, level 7 is probably high school games, state level, etc) you must pass fitness exams as well as paper exams. Level 2 is FIFA assistant referee, so they must all be in quite good shape.
nolite 12y ago
would be interested in the tech behind this... voice recognition?

143 points by sunpazed 12y ago

vomitcuddle 12y ago

Not a big fan of soccer, but this is really cool!

zetx 12y ago
They have other TV programs being streamed as well. Looks like 6 channels. (Ex: http://beta.tveeder.com/560/live http://beta.tveeder.com/560/live )
- sunpazed 12y ago
  Yes - there's 6 streaming, see: http://tveeder.tumblr.com/post/60161190670/weve-just-graduated-from-alpha-to-beta-with-the http://tveeder.tumblr.com/post/60161190670/weve-just-graduat... The architecture allows for additional channels as needed.
  - sebastianavina 12y ago
    This could be the next big thing on the hipster world... - What are you doing? - Just here, reading TV

GFischer 12y ago

Very nice :) . Are these captions taken from a live text commentary (like BBC's service), or from a radio commentary? I think the second would be more useful, since they tend to mention players and plays more often. A nice case of tech helping people with disabilities, great job and good luck !

goatforce5 12y ago
The linked posting (now?) says the captions are coming from SBS Australia.
- GFischer 12y ago
  Yes, it did when I read the posting, but is that live audio commentary transcribed or live text commentary? I think realtime-transcribed live audio commentary would be more timely and lively :) though also harder to do I guess. In either case it's a great service. Edit: it apparently IS computer-generated live audio! Amazing :) There are some syncing services between radio and streaming - for example here in Uruguay we like the local radio commentary, and so do the Brazilians and Argentineans, we might watch a match on tv with the sound turned off and radio turned on.
  - newscasta 12y ago
    Probably too late now that the conversation has moved on, but if you happen to see this could you point me to one of these syncing services? A very quick google search didn't turn up anything. Thanks.
dean_cognation 12y ago
curious how you are handling the copyright issues?.,..... or just hoping they don't notice?

parfe 12y ago

I don't understand the service. When watching tv with my hearing impaired father I push the CC button. For the world cup specifically the espn announcers perform so terribly we likely won't even do that and have music playing instead.

carlob 12y ago
I remember watching a match during a strike of announcers in Italy, where announcers are supposedly very knowledgeable about soccer. It was one of my best experiences in soccer ever, beat only by when I started using my radio to listen to a group of comedians commentary.
roberthahn 12y ago
Not all tv programmes are captioned. Sometimes pushing the CC button won't work :-) Then something like this becomes incredibly useful. EDIT: Also, (and I'm not sure if tveeder supports this) but making this a web service means that even hearing people can search for the resulting transcripts as easily as any other text.

roberthahn 12y ago

I wish I could upvote this a hundred times. This is exactly the kind of thing I like to see more of. Is this your project, sunpazed? Nicely done! EDIT: Wait, what? Did that guy really say: "Yes. It's edgy stuff, this. It will ruffle a few ferts. Will say something some people won't like. Hopefully they won't be watching the show. It wasn't very difficult to give Tony Abbott a dick and balls. He was holding this at the time." I spotted some other weird bits, (I have nothing to compare it to) Is this is computer-based voice recognition? I have to admit it's a lot better than Youtube's terrible excuse for captioning - most of what I see on this page looks pretty coherent and on topic.

sunpazed 12y ago
Yes, it is. Myself, and a small group of enthusiasts developed the service. We launched in 2011, with the idea that the hearing impaired could use the service to access a great source of realtime information - television. The hearing impaired could now objectively access and review online the quality of captions delivered by broadcasters. Since then, it has grown into a useful resource for everyone. One of the biggest benefits, we believe, is that our service raises the awareness of captioning to others who haven’t traditionally relied on it. For those technically minded, it's a client-server model built with custom client hardware. Currently, we're only streaming Australian channels, however, there's scope to plug in any terrestrial broadcast, and feed it into TVeeder. There's a REST API too.
- roberthahn 12y ago
  That's pretty awesome. Thank you for stepping up to work on this.
- GFischer 12y ago
  Thanks for the clarification, that's more what Hacker News readers want to know :) . I wish you best of luck and congratulations.
- nivertech 12y ago
  what about Streaming API?

hellbreakslose 12y ago

Hmm ok nice idea but i think BBC is already having that functionability ... livetime game commentating.

vermontdevil 12y ago

I'm deaf and many many thanks for this. I will share with others.

rblatz 12y ago

Yesterday when I brought up ESPN's streaming feed they had an option to stream a video with closed captioning. Is this your source?

brassattax 12y ago

Do you have a way for people around the world to provide additional content? For example if I have a tuner card, and want to run some service to extract screenshots and CC text to send to you via some sort of API

sunpazed 12y ago
Yes. However, it does require custom hardware. We've prototyped a small hardware platform to allow others to contribute to the live feed. However, this remains at prototype stage - we've been running self funded since inception.

jcfrei 12y ago

Hmm, the stream doesnt load for me at the moment. Is it location restricted or are there too many users right now? The other streams work.

joeyspn 12y ago

Well done sir! There's so much talk about UX lately and still just few really think about real problems like Accessibility

robinhowlett 12y ago

Very well done. I experimented once with Sports broadcast captioning (not real-time though; using YouTube videos) by using Amazon Mechanical Turk for crowdsourced closed-captioning. An example is here: https://www.youtube.com/watch?v=MCgc1jAXGSk https://www.youtube.com/watch?v=MCgc1jAXGSk

eliben 12y ago

This is a very nice service - well done. Tangentially, most soccer commentary (esp. in the US) is so horrible it's not a big loss not being able to hear. Just watch the game ;-)

bhandziuk 12y ago

Isn't being deaf and watching soccer more like being there in person? Whenever I go see live matches there is no announcer. The ref has no mic and makes no hand gestures and there are no jumbo-tron close ups on anything important. Very difficult but apparently genuine. Part of the barrier to entry for football fans I suppose.

dragonwriter 12y ago
> The ref has no mic and makes no hand gestures While, from the stands, they may be difficult to see, soccer referees definitely make standardized hand signals.
- bhandziuk 12y ago
  Is it only done the instant they make the call or is it repeated after the fat like in american football/hockey? I'll have to take your word for it because from where I've sat I could see nothing :)
  - gamegoblin 12y ago
    Main ones off the top of my head: Arm straight up: offside Arm towards goal line: goal kick Arm towards corner: corner kick Arm in one direction or the other indicates throw in direction (if it was a close call -- often there isn't any chance for dispute and the team knows what's what and throws it in within a second or two if there is a hurry). There is a "play on" type arm wave (usually accompanied by a verbal "play on" or something) to indicate "yes I saw him fall, no I don't think it's a foul, keep playing". The line referees have flags and have similar signals. The only real difference is for a foul they hold the flag straight up and wave it a little. For offside they hold it straight up and stand still to mark where the offside occurred. The line referee should always be located at the exact line that marks offside. Of course pro players are faster than referees, but to get past level 7 refereeing (starts at level 9, kids games, level 7 is probably high school games, state level, etc) you must pass fitness exams as well as paper exams. Level 2 is FIFA assistant referee, so they must all be in quite good shape.

nolite 12y ago

would be interested in the tech behind this... voice recognition?