5 ms·
I was decided to spend 10-ish minutes validating voices, because why not. I did not hear any lines that were flat-out spoken incorrectly, at least as far as I
by Wowfunhappy 8y ago
I was decided to spend 10-ish minutes validating voices, because why not.
I did not hear any lines that were flat-out spoken incorrectly, at least as far as I could tell. However, I did come across a ton of really poor samples, to the point of being somewhat difficult to understand. Things like:
• Really strong accents
• Horrible, muffled microphones
• Background noise
• Super quiet
• A couple "robotic" samples I legitimately think were generated via text-to-speech software
All of these types of samples—save the last—constitute possible real-world scenarios. But, do they make for good training data? I very little about machine learning, but it makes logical sense to me that you'd want to teach the computer with "clean" data—something with a high signal-to-noise ratio which is as close to the "average" of the real world as possible. Is this completely wrong?
Separately, they ought to provide this type of instruction on what to do with borderline samples. If I legitimately can't tell for sure whether a word was spoken correctly, what should I do?
- opportune 8y agoYes, you do want the bad voice samples precisely because they correspond to actual input that a model might receive. A dataset with only clear samples would likely have a stronger "signal" overall meaning it might be easier for an academic testing a model to get higher test accuracy training on that data. The bad data makes the model more robust to non-ideal input types
- XMPPwocky 8y agoIn fact, it's not uncommon to take a dataset and deliberately, randomly distort it- for images, things like scaling, rotating, cropping, blurring, altering color balance and gamma, flipping, adding random noise... The idea is to make the model resistant to that "bad" input and effectively enlarge your dataset for free- if you have a picture of a cat, you can automatically also get loads of pictures that you know should still be classified as a cat- rotated 15 degrees clockwise, noisy (like in low-light conditions), the tip of its tail is out of frame, the camera's automatic white balance screws up... Also, the robotic samples may be real human voices mangled by LPC- Think a lossy VoIP call.
- dabinat 8y agoYes, it would be good if Mozilla provided detailed validation guidance. Until then, there are some good tips in this thread: https://discourse.mozilla.org/t/listen-guidance/35608 https://discourse.mozilla.org/t/listen-guidance/35608