3 ms·

> you first have to decipher what the speaker was trying to say This is also where the quality is varying a lot between languages. I'm a native French speaker

> you first have to decipher what the speaker was trying to say This is also where the quality is varying a lot between languages. I'm a native French speaker with an heavy non-standard accent and no speech recognition currently works for my normal voice. I also speak Vietnamese to an okay level and while the speech recognition is usually good, the fact that the language is not based on words but syllables usually trips machine attempts at translation and the result is generally pretty bad. These kind of live translations while impressive require the full pipeline to work, speech recognition and then proper translation. If any of them fail, the whole thing fails. On my case, it only works with my English for now then.

tkgally 3y ago
> These kind of live translations while impressive require the full pipeline to work, speech recognition and then proper translation. That's a good point. Machine translation of text input by LLMs is pretty good for the languages I speak--English and Japanese--but it can get much worse with spoken input if the speech recognition isn't very good. That said, OpenAI's Whisper is able to transcribe my spoken English nearly perfectly, and GPT-4's translation of that transcription into Japanese is usually very good. The main failures are with proper names.