3 ms·
Commonly understood in the field^ is that 60,000 examples is the sweet spot for training and validation data, 50k for training 10k for test/validation. This is
by AndrewKemendo 9y ago
Commonly understood in the field^ is that 60,000 examples is the sweet spot for training and validation data, 50k for training 10k for test/validation. This is largely because the MNIST set is exactly that size and is so commonly used successfully. Get very high accuracy and reduces instances of overfitting.
That said you can do a lot with a relatively little set. This 2012 paper puts the range between 80-570 samples [1] again depending on model and required outcomes. Leslie Smith at NRL has been working on this problem as well and showing some great progress on really small sample sets as well.
Major takeaway here is that there is such a thing as too big, and too small of data sets for classification accuracy, but those definitions are rapidly changing.
^Your mileage may vary depending on model, fine tuning, transfer learning etc...
[1]https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3307431/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3307431/
- zeroxfe 9y ago> Commonly understood in the field^ is that 60,000 examples is the sweet spot for training and validation data, 50k for training 10k for test/validation. I don't understand how this could be true. Shouldn't the sweet spot be a function of the dimensionality of the data?
- amelius 9y agoNo, the deep learning network should be smart enough to reduce the data to its essence (and that's what it ultimately does). If DL would need more training data for higher dimensional inputs, then DL would lose against a simple pattern matching (correlation) algorithm at some point.
- landon32 9y agoImagine you are trying to use a neural network to classify single bit data as either being 1 or 0 (I know you obviously don't need a neural net for this, but it's an example). Aside from not needing a very deep network, you would not need much training data. Then imagine classifying the color of a single pixel as "light" or "dark". There's three dimensions-- red, green, and blue. You would also need much less training data here than if you were trying to train a network to recognize a car, right? I think this is what zeroxfe is referring to