3 ms·

Show HN: I've created automated synced audio-translations

3 points by picki 5y ago

picki 5y ago
Hi all, our team is now playing with the technologies like Machine-learning translations + Speech synthesis processes. We are testing these on the project which has a code name polyvid.io and gives us the idea of the proper technologies usage. The project allows you to have a synced video translation into multiple languages. Pretty useful if you do not want to decode the video yourself! Just enter the link on the home page and select your language. If you want to have a look and give any feedback, I am more than happy to have a chat or listen any critics. One thing to note, that is an early stage prototype, so the resources we use are limited for it for now. Currently, you can translate from all English videos to any of the listed language below and vice-versa: Chinese, English, French, German, Japanese, Italian, Russian, Spanish * We hate to re-invent the wheel, so if anyone knows something similar, PLEASE send the examples so our team does not spend a half of a year on re-creating some existing functionality!
huhtenberg 5y ago
The video on the linked page started playing, verbalized the first few phrases (ending with "... recent years") and then went silent. The video kept on playing, the subs were changing, you can hear the original (muted down) soundtrack, but the narration audio was gone. Skipped forward by a minute or so, the narration resumed and then again stopped once the current subtitle was exhausted. Subsequent dragging of the video slider made no difference, the narration stayed off. The dev console shows "Uncaught (in promise) DOMException: The play method is not allowed by the user agent or the platform in the current context, possibly because the user denied permission." popping up, seemingly randomly, both when the narration was playing and when it was not. This is in a recent Firefox on Windows. PS. FWIW, the quality of the narration is really good.
- picki 5y ago
  Thank you, that's a really nice check - looks like there are some differences in browsers. I'll check and get back with the updated :) Many thanks for that time you've spent!!!
  - huhtenberg 5y ago
    Not a problem. This looks like a interesting and useful project. If you manage to resolve this issue, do post an a quick update here. I'd be happy to pitch this to the mods for a boost on your behalf.
    - picki 5y ago
      Hmmm, tried to reproduce in Firefox, Safari, on different machines but still no luck. I'll find it though. Could you please let me know the Firefox version use? Cheers!

3 points by picki 5y ago

Hi all, our team is now playing with the technologies like Machine-learning translations + Speech synthesis processes. We are testing these on the project which has a code name polyvid.io and gives us the idea of the proper technologies usage. The project allows you to have a synced video translation into multiple languages. Pretty useful if you do not want to decode the video yourself! Just enter the link on the home page and select your language. If you want to have a look and give any feedback, I am more than happy to have a chat or listen any critics. One thing to note, that is an early stage prototype, so the resources we use are limited for it for now. Currently, you can translate from all English videos to any of the listed language below and vice-versa: Chinese, English, French, German, Japanese, Italian, Russian, Spanish * We hate to re-invent the wheel, so if anyone knows something similar, PLEASE send the examples so our team does not spend a half of a year on re-creating some existing functionality!

huhtenberg 5y ago

The video on the linked page started playing, verbalized the first few phrases (ending with "... recent years") and then went silent. The video kept on playing, the subs were changing, you can hear the original (muted down) soundtrack, but the narration audio was gone. Skipped forward by a minute or so, the narration resumed and then again stopped once the current subtitle was exhausted. Subsequent dragging of the video slider made no difference, the narration stayed off. The dev console shows "Uncaught (in promise) DOMException: The play method is not allowed by the user agent or the platform in the current context, possibly because the user denied permission." popping up, seemingly randomly, both when the narration was playing and when it was not. This is in a recent Firefox on Windows. PS. FWIW, the quality of the narration is really good.

picki 5y ago
Thank you, that's a really nice check - looks like there are some differences in browsers. I'll check and get back with the updated :) Many thanks for that time you've spent!!!
- huhtenberg 5y ago
  Not a problem. This looks like a interesting and useful project. If you manage to resolve this issue, do post an a quick update here. I'd be happy to pitch this to the mods for a boost on your behalf.
  - picki 5y ago
    Hmmm, tried to reproduce in Firefox, Safari, on different machines but still no luck. I'll find it though. Could you please let me know the Firefox version use? Cheers!