We explored self-attention + CTC in our ICASSP 2019 paper (https://arxiv.org/abs/1901.10055 https://arxiv.org/abs/1901.10055). Our implementation uses internal

We explored self-attention + CTC in our ICASSP 2019 paper (https://arxiv.org/abs/1901.10055 https://arxiv.org/abs/1901.10055). Our implementation uses internal infra, so we're a ways from releasing code :( Hoping paper details suffice and help with the parameter search, and happy to respond to questions over e-mail. Would love to see an open-source implementation with local or directed attention built out!