4 ms·
I believe what he means by "data validation" is to validate that your data is matching up with reality. For example if you do real estate predictions but your d
by fxtentacle 4y ago
I believe what he means by "data validation" is to validate that your data is matching up with reality. For example if you do real estate predictions but your data set doesn't include any low-price sales because your broker didn't list them. Then your data doesn't cover the lower-price part of reality, so all of your predictions are going to drift upwards, due to the gap in your data.
- nl 4y agoThis is correct, and strongly typed languages don't help. Often your data validation process does things like running descriptive statistics (means, standard deviations, etc) on particular columns and making sure they are within reasonable ranges. Strongly typed languages don't have any particular advantage for this kind of thing.