3 ms·
"This takes 2 weeks of A100 GPU time to train?" Yes, but only for me in this specific case. That's because this German model was derived based on a model which
by fxtentacle 4y ago
"This takes 2 weeks of A100 GPU time to train?"
Yes, but only for me in this specific case. That's because this German model was derived based on a model which was pre-trained for months on hundreds of thousands of hours of YouTube audio in various languages. So if I now train an English recognizer, I don't start from scratch. Instead, I start from a checkpoint which can already almost flawlessly recognize any human utterance. (Or all phonemes in the IPA alphabet, to be more precise)
The "training" then only learns the mapping between IPA phonemes and text notation.
- deleted 4y ago[deleted]
- mciancia 4y agoWhat other languages can you "easily" do like that?
- fxtentacle 4y agoI believe for English, German, Dutch, Spanish, French, Italian, Portuguese, Polish there's enough data in CommonVoice to get good results.
- gogusrl 4y agoAny chance for Romanian ?
- fxtentacle 4y agoFor Romanian, I believe someone would first have to collect a large dataset of speech recordings together with groundtruth text. Even if you find cheap narrators working for $10 per hour, that's still $100k for 10k hours of data.