4 ms·
It may not be the top, but heavily tonal languages like Vietnamese may be near the top: https://en.wikipedia.org/wiki/Vietnamese_language https://en.wikipedia.o
by thanhhaimai 6y ago
It may not be the top, but heavily tonal languages like Vietnamese may be near the top:
https://en.wikipedia.org/wiki/Vietnamese_language https://en.wikipedia.org/wiki/Vietnamese_language
A lot of sounds and nuances are not visible at the lip level. You still may be able to guess something based on the context, but an ML model based purely on lip visual will fail pretty hard.
- retrac 6y agoI largely agree. But tone is, in practice, more than just the pitch. I know that in Mandarin it ends up affecting vowel length, volume and quality a little bit as well. I'm pretty sure you could do much better than chance just with lip position over time, for example. And practical lipreading looks at much more than just lip position.