5 ms·

I was watching a graphic novel on YouTube yesterday that was translated from Japanese text into an English narration. It was weird, not perfect, probably copyri

I was watching a graphic novel on YouTube yesterday that was translated from Japanese text into an English narration. It was weird, not perfect, probably copyright infringement, but pretty effective. I think it’s only a matter of time until we have real time local translator hardware that we can just plug in our ear when traveling, or heck, working in another country where you don’t speak the local language. Language barriers are going to fall quickly.

xeonmc 1y ago
They could even make it fish-shaped!
- whatevermom 1y ago
  If they don’t, I will.
lukax 1y ago
Have you seen Soniox? They support real-time translation (only speech to text translation for now). https://soniox.com/ https://soniox.com/ (disclaimer: I worked there)
- seanmcdirmid 1y ago
  You know someone will figure out how to do real time translation and use the same voice as the speaker, or if you have a room with more than speaker, rather than figure out who you are listening to, just do them all and remix according to how the input sources were mixed.
  - junon 1y ago
    There was just a demo for this posted like a week or two ago between an English and Korean speaker, I'll see if I can find it and edit/comment again.
    - pezezin 1y ago
      I wonder how well that will work given the differences in grammar and word order. I have seen a similar solution applied between English and Japanese, which has a similar grammar to Korean, and the results were... not impressive.
eurleif 1y ago
It's no doubt possible to have translation with less lag on average than current tools like Google Translate's Conversation Mode, but truly real-time translation is impossible because of word order differences. You can't translate a word you haven't heard yet.
- ptero 1y ago
  But truly realtime translation is rarely (never?) critical. For streamed media there is usually enough of a buffer to handle word order swaps without delay (although one can make contrived counter-examoles), and for human interactions that delay is likely less than normal human processing time.
- jcattle 1y ago
  Reminds me of a letter to the Times regarding German word order (and the fact that the verb often comes last) > Sir, Your reader's reference to German word order reminds me of a UN meeting at which I worked when the German delegate ranted for ages while all French eyes turned to the French interpreter booth. The interpreter witheringly interjected "j'attends le verbe".
pjc50 1y ago
The auto-dubbing on youtube has the classic hallmark of an AI product: you can't turn it off easily. (the audio track switcher, which will give you back the original audio, is not available on mobile. Fortunately if you use newpipe it is ..) > real time local translator hardware that we can just plug in our ear when traveling These are definitely already a thing, popular in Asian countries. https://www.aliexpress.com/item/1005008777097933.html https://www.aliexpress.com/item/1005008777097933.html
a-french-anon 1y ago
"Watching" a graphic novel??
- deleted 1y ago
  [deleted]

xeonmc 1y ago

They could even make it fish-shaped!

whatevermom 1y ago
If they don’t, I will.

lukax 1y ago

Have you seen Soniox? They support real-time translation (only speech to text translation for now). https://soniox.com/ https://soniox.com/ (disclaimer: I worked there)

seanmcdirmid 1y ago
You know someone will figure out how to do real time translation and use the same voice as the speaker, or if you have a room with more than speaker, rather than figure out who you are listening to, just do them all and remix according to how the input sources were mixed.
- junon 1y ago
  There was just a demo for this posted like a week or two ago between an English and Korean speaker, I'll see if I can find it and edit/comment again.
  - pezezin 1y ago
    I wonder how well that will work given the differences in grammar and word order. I have seen a similar solution applied between English and Japanese, which has a similar grammar to Korean, and the results were... not impressive.

eurleif 1y ago

It's no doubt possible to have translation with less lag on average than current tools like Google Translate's Conversation Mode, but truly real-time translation is impossible because of word order differences. You can't translate a word you haven't heard yet.

ptero 1y ago
But truly realtime translation is rarely (never?) critical. For streamed media there is usually enough of a buffer to handle word order swaps without delay (although one can make contrived counter-examoles), and for human interactions that delay is likely less than normal human processing time.
jcattle 1y ago
Reminds me of a letter to the Times regarding German word order (and the fact that the verb often comes last) > Sir, Your reader's reference to German word order reminds me of a UN meeting at which I worked when the German delegate ranted for ages while all French eyes turned to the French interpreter booth. The interpreter witheringly interjected "j'attends le verbe".

pjc50 1y ago

The auto-dubbing on youtube has the classic hallmark of an AI product: you can't turn it off easily. (the audio track switcher, which will give you back the original audio, is not available on mobile. Fortunately if you use newpipe it is ..) > real time local translator hardware that we can just plug in our ear when traveling These are definitely already a thing, popular in Asian countries. https://www.aliexpress.com/item/1005008777097933.html https://www.aliexpress.com/item/1005008777097933.html

a-french-anon 1y ago

"Watching" a graphic novel??

deleted 1y ago
[deleted]