Someone else has already posted this above, but the K2 project [0] is intended to do exactly this (along with some nice integration into PyTorch). There's a bi

Someone else has already posted this above, but the K2 project [0] is intended to do exactly this (along with some nice integration into PyTorch). There's a big cross-over with the Kaldi team, so this seems (partly) motivated by a desire to improve/expand Kaldi to combine WFSTs with auto-grad learning (though K2 as a whole is a generic framework, and nothing is specific to voice). It's still in its early days and I haven't delved into the details yet, but I suspect this will be the go-to method for speech recognition in a few years' time. Given that a few other teams are working on similar toolkits (see elsewhere in this thread), it seems a lot of people see promise. https://github.com/k2-fsa https://github.com/k2-fsa