3 ms·
> These are very small evaluation sets for deep learning. Evaluation is a statistics question, and it doesn't matter that the deep learning model used is high
by feral 7y ago
> These are very small evaluation sets for deep learning.
Evaluation is a statistics question, and it doesn't matter that the deep learning model used is high capacity and needs a lot of training data.
There's nothing inherently wrong with validating a complex model on a small amount of data.
The paper has a section 4.2 that gives a statistical analysis. Granted, it'd be nicer if they had enough data to show statistically significant differences.