3 ms·
Kaggle is pretty awesome and I hope to use it myself one day. The article makes a good point that a lot of the most interesting data sets just aren't that big.
by tryitnow 15y ago
Kaggle is pretty awesome and I hope to use it myself one day.
The article makes a good point that a lot of the most interesting data sets just aren't that big. This is worth pointing out because I've noticed that there has been some conflating of "Big Data" and "Data Science." These two buzzwords are related but one does not imply the other. Big data is just that, working with really large data sets (I think with the implication that the data are unstructured).
Data science can include Big data as well as little data. It also seems to cover both structured and unstructured data.
- jph00 15y ago(Disclaimer: I'm the "accidental scientist" profiled in this article.) Yes I've noticed this as well. People are often asking me for my opinion about Big Data, treating it as a synonym for Data Science. Since the journalist at Wired had recently written a couple of articles about Hadoop, I took this opportunity to explain to him how data size and data value are not necessarily directly related. I think he did a great job in the piece of getting this point across.
- lurker17 15y agoI think you'll find that Hadoop is often used in preparing the data into bite-size chunks for use in Kaggle contests. Also, sometimes the contest winners do win by fetching more data related data than Kaggle provides. This happened in the Wikipedia participating-prediction contest, for example.
- lurker17 15y agoThanks for Fastmail!