3 ms·
Will you remove some of the obvious fake outliers from the data set? eg. Line 338 on the .csv file is a 99 year old female self-employed, pre-high schooler with
by vitaminj 17y ago
Will you remove some of the obvious fake outliers from the data set? eg. Line 338 on the .csv file is a 99 year old female self-employed, pre-high schooler with 10+ kids working 140 hours per week and earning $1M per year. Sounds a little suspect to me...
Not to mention the 22 year old student who completed the questionaire 4 times and has 70 years of experience, works negative hours and earns $100M.
Or the divorced 407 year old female with 700 years of experience and 8 kids.
- tialys 17y agoI decided not to filter the data in the interest of giving anyone the ability to use the exact data set I received. For my personal use, yes, I removed the bad data. But as far as giving out the csv, I thought it made more sense to give people the full set and let them decide (honestly, some people are fishy, but not obviously fake... so it'd be hard to be fair).