I've recently seen this slidedeck [1] from guys on Twitter's data team where they say that most of the time the data mining process is basically: 1. Your boss

I've recently seen this slidedeck [1] from guys on Twitter's data team where they say that most of the time the data mining process is basically: 1. Your boss says something vague 2. You think very hard on how to move the needle 3. Where’s the data? 4. What’s in this dataset? 5. What’s all the f#$#$ crap in the data? 6. Clean the data 7. Run some off-the-shelf data mining algorithm 8. ... 9. Productionize, act on the insight 10. Rinse, repeat [1] http://www.slideshare.net/Hadoop_Summit/scaling-big-data-mining-infrastructure-twitter-experience http://www.slideshare.net/Hadoop_Summit/scaling-big-data-min...