3 ms·
>The first step to training a neural net is to not touch any neural net code at all and instead begin by thoroughly inspecting your data. This step is critical.
by 6gvONxR4sf7o 8y ago
>The first step to training a neural net is to not touch any neural net code at all and instead begin by thoroughly inspecting your data. This step is critical.
This can't be overstated. I can't count the number of times I'm the first person to find a problem with the data. It's incredibly frustrating. Just look at your damned data to sanity check it and understand what's going on. Do the same with your model outputs. Don't just look at aggregates. Look at individual instances. Lots of them.
- distant_hat 8y agoThe number of kids who dive right into modelling without sanity checking, visualizing, or otherwise exploring through the data is shocking. Also, people who just look at the metrics and decide the model is better because lower error ignoring that at times the output is meaningless, like getting negative probabilities.
- odnes 8y agoI was guilty of this once and would add some more specific advice; if your dataset consists of multiple possible labels for the same samples, do not just assume that the average of these labels will describe the best label. And don't assume that training with the unclean data will produce a net that magically learns to do the aggregation for you.