4 ms·
> The main innovation is that we prevent loss mis-allocation during training of the acoustic AI model by pre-weighting things with the loss of the language mode
by cgeier 4y ago
> The main innovation is that we prevent loss mis-allocation during training of the acoustic AI model by pre-weighting things with the loss of the language model. Or in short:
> We don't train what you don't need to hear
This does sound a lot more interesting than the ~280 lines of code.
- fxtentacle 4y agoFor a researcher, yes. But for understanding the trick there, you need to have read and understood the CTC loss paper. For people like my industry clients, on the other hand, "code that is easy to audit and easy to install" is a core feature. They don't care about the research, they just want to make audio files search-able.