6 ms·
A important point is that it's an absolute pain in the ass to preprocess tabular data for neural networks. Categorical > one hot encoding > deal with new categ
by savant_penguin 4y ago
A important point is that it's an absolute pain in the ass to preprocess tabular data for neural networks.
Categorical > one hot encoding > deal with new categories in test time (sklearn does this, but it's really slow and clunky)
Numerical > either figure it out the data distribution for each column and normalize by that or normalize everything by z score. Found an outlier?? Oops, every feature collapsed to 0
Can you that for 10 features? Sure, now try it again with 500, it's not fun
Ok, now that you've done all that you can begin training and possibly get some reasonable result.
Compare that with tree models: data>model>results
- johnthewise 4y agoYou could encode categorical variables into embeddings, they are more natural to deal that way. https://tech.instacart.com/deep-learning-with-emojis-not-math-660ba1ad6cdc https://tech.instacart.com/deep-learning-with-emojis-not-mat...