3 ms·
The best way to learn how to wrangle data is practice, especially outside of academic settings, where the example data is not necessarily reflective of real-wor
by minimaxir 10y ago
The best way to learn how to wrangle data is practice, especially outside of academic settings, where the example data is not necessarily reflective of real-world data.
Helping others wrangle data is one of the reasons I publish my Jupyter notebooks open-sourced. A few examples my data wrangling with R:
Processing Stack Overflow Developer data: https://github.com/minimaxir/stack-overflow-survey/blob/master/stack_overflow_dev_survey.ipynb https://github.com/minimaxir/stack-overflow-survey/blob/mast...
Identifying related Reddit Subreddits: https://github.com/minimaxir/subreddit-related/blob/master/find_related_subreddits.ipynb https://github.com/minimaxir/subreddit-related/blob/master/f...
Determining correlation between genders of lead actors of movies on box office revenue: https://github.com/minimaxir/movie-gender/blob/master/movie_gender.ipynb https://github.com/minimaxir/movie-gender/blob/master/movie_...
- iamjeff 10y agoThe "Analysis of Lead Gender and Box Office" project put a smile in my face because it looks like so much fun- that is something that I would like to know how to do in the coming months. Thank you for open sourcing the notebooks and the recommendation to practice then demo on real data.
- nl 10y agoThis. I'd add that Kaggle is very good for the "other end" of data science: they generally have pretty clean data, and clear problem descriptions. In real life the data is never clean and the problems are rarely known in advance.
- benhamner 10y agoWe also are growing https://www.kaggle.com/datasets https://www.kaggle.com/datasets, which won't necessarily have clean data, clear problem statements, and a well-defined task.