5 ms·
So, what caught my interest was this quote at the bottom: "Alternatively, you can donate roughly 2 weeks of A100 GPU credits to me and I'll train a suitable rec
by kevin_b_er 4y ago
So, what caught my interest was this quote at the bottom:
"Alternatively, you can donate roughly 2 weeks of A100 GPU credits to me and I'll train a suitable recognition model and upload it to HuggingFace."
This takes 2 weeks of A100 GPU time to train? Current GC spot pricing puts that at about $300.
- fxtentacle 4y ago"This takes 2 weeks of A100 GPU time to train?" Yes, but only for me in this specific case. That's because this German model was derived based on a model which was pre-trained for months on hundreds of thousands of hours of YouTube audio in various languages. So if I now train an English recognizer, I don't start from scratch. Instead, I start from a checkpoint which can already almost flawlessly recognize any human utterance. (Or all phonemes in the IPA alphabet, to be more precise) The "training" then only learns the mapping between IPA phonemes and text notation.
- deleted 4y ago[deleted]
- mciancia 4y agoWhat other languages can you "easily" do like that?
- fxtentacle 4y agoI believe for English, German, Dutch, Spanish, French, Italian, Portuguese, Polish there's enough data in CommonVoice to get good results.
- gogusrl 4y agoAny chance for Romanian ?
- fxtentacle 4y agoFor Romanian, I believe someone would first have to collect a large dataset of speech recordings together with groundtruth text. Even if you find cheap narrators working for $10 per hour, that's still $100k for 10k hours of data.