4 ms·
I question that you need full attention in the acoustic model. The pronunciation of a word in the middle of phrase does not have much dependence on the beginnin
by option 7y ago
I question that you need full attention in the acoustic model. The pronunciation of a word in the middle of phrase does not have much dependence on the beginning.
You do need attention in the language model part of the pipeline
- albertzeyer 7y agoAlmost all the literature which compares CTC and encoder-decoder-attention models shows pretty well that encoder-decoder-attention performs better than CTC in the acoustic model. See for example here as an overview (my own work, already a bit outdated, but attention has even improved much more since then): https://openreview.net/pdf?id=S1gp9v_jsm https://openreview.net/pdf?id=S1gp9v_jsm