I dealt with this issue in my PhD research on data mining, and it motivated me to search for a new line of work. The benefits of data based products never justi

I dealt with this issue in my PhD research on data mining, and it motivated me to search for a new line of work. The benefits of data based products never justify the customers changing everything just to make life easier for the data nerd in the corner (in my case at least). What made them happiest was when i assembled some basic tools to mine their data on their own - "teaching a man to fish, ruining a business opportunity". I think dirty data are like the refs in a football game. Nobody comes to see them, but they'll be part of the game until you have perfect players.