4 ms·
> I don't believe that phonemes are real I used to think the same until I came across the VQ-VAE paper [1], where the goal was to let the model learn the small
by stonelazy 1y ago
> I don't believe that phonemes are real
I used to think the same until I came across the VQ-VAE paper [1], where the goal was to let the model learn the smallest units of speech without any supervision. Interestingly, the model ended up learning units that closely aligned with the phonemes we recognize today.
[1] - https://arxiv.org/pdf/1711.00937 https://arxiv.org/pdf/1711.00937
- Nopoint2 1y agoThe gibberish it produces shows that something quite different is being encoded. It completely fails with Spanish. There is no reason why it would, if it used phonemes. They think that the footnote explains the poor accuracy, but that is in fact how phonemes supposedly work.