13 ms·
Launching our Data Science and Big Data Track
- marrone12 13y agoThis is a cool idea, but I wish everything wasn't so 'big data' oriented. Most people will never work with big data. Instead of teaching me map/reduce, how about teaching me how to model with a mixture distribution? Teach me how to master small data and then scale those up to big data when and if need be.
- bchjam 13y agoCloudera seems to be sponsoring this class and both instructors are from there. I think that explains why the class has a "Big Data in Hadoop" theme, since that's what Cloudera does. (as a comic aside to the buzzwordiness of "Big data", I saw a tweet yesterday that lamented rising use of the term "Hyper data". Which was followed by a reply about approaching "Ludicrous data", with a link to Spaceballs' ludicrous speed scene)
- stinkytaco 13y agoI would also like something like this. I deal with data in my job all the time, everything from surveys to web analytics to customer data, but I only have a foggy notion how to work with it. As a result, most of the output is fairly simple, obvious metrics, but it would be nice to get a few online courses on how to do basic stats, construct surveys, do UI and A/B testing, etc.
- joshz 13y agoYou might like Data Analysis from Coursera. https://www.coursera.org/course/dataanalysis https://www.coursera.org/course/dataanalysis From the post it looks like Udacity too is working on courses that address this.
- thaddeusmt 13y agoI'm working through this course (and took the earlier sister course Computation for Data Analysis with R). It's quite good so far. They stay away from the "big" part and focus on the core of data analysis: how to find data, clean it up, explore it, find relationships and present your findings. We are using R, which is suitable for most data sizes. It's offered by Johns Hopkins, and has more of an academic bent than an industry one. Great general purpose knowledge that I think you would want before you start messing around with Hadoop.
- deleted 13y ago[deleted]
- jsaxton86 13y agoIt seems that the majority of Big Data/Data Science applications are designed to give advertisers insight into things I don't really want them to have insight into. That really sucks, because the technology is cool, but I don't want to help build that kind of future. It's kind of analogous to how I feel about Computer Vision: there are a handful of legitimate purposes for it, but most applications of the technology fall somewhere between "I don't like that idea" to "that's totally unethical".
- xradionut 13y agoWhy not grab some public domain data sets and build something on that? There's some really nice sources that can be discovered at data.gov and other places. Much of it could be used to inform and educate the public. You probably could build a small business or consultancy if you choose correctly.
- jchendy 13y agoYeah, there's definitely a lot of good to be done with these techniques and technologies. Like these dudes: http://cusp.nyu.edu/ http://cusp.nyu.edu/
- mathattack 13y agoThere are plenty of Big Data applications that aren't unethical. Back in the 90s (before the term Big Data was conceived) two of the biggest users of Teradata were P&G and Wal*mart. It was more about supply chain and retail store efficiency than anything nefarious. Big data helped make sure that store shelves had what people wanted. Today there are mass spamvertising campaigns on Big Data, but there are also applications on financial services (making sure our pension funds take the right risk), engineering, telecom and elsewhere that help improve our lives.
- sanskritabelt 13y agoHelping Walmart is, at best, morally suspect.
- Rickasaurus 13y agoUgh, Hadoop.
- waitingkuo 13y agoMost Udacity courses use Python, but seems this data science series will use R. Python also has lots of data analysis tool. Just wonder why they are choosing R.
- minimaxir 13y agoR's data science tools are mostly native.
- suhair 13y agoIntroduction to Hadoop and Mapreduce course seems to have the right amount of content. It could be completed in one sitting and content is polished, well presented , and easy to grasp. Respect to Cloudera faculty. As an added bonus, uses python instead of java for examples.
- Littleme 13y ago(Course author here) Thanks. We chose Python because it's a little more approachable for many people that Java, and is the language used in Udacity's Comp Sci 101 course. Also, using Hadoop Streaming saved us from having to explain a bunch of concepts such as WritableComparables, InputFormats etc that would just have got in the way of the basic MapReduce principles.
- stiff 13y ago99% of people looking for information about big data and 99% of people looking to do data science, don't have nowhere near big data, and don't need to be taught hadoop. Those people are instead often lacking fundamental knowledge and are looking for a trick technological solution instead of reviewing their basics. A "data science" track should hence be 90% about algorithms, data structures, linear algebra and computer architecture. People need to know how to compute with matrices, how to use B-trees, what R-trees are, what SIMD is, what cache locality is, what package to use for practical linear algebra, what the gpu is good for and when and how to use it. Teach databases, but include also some of the theoretical database stuff, and teach how to correctly use relational databases in the first place, since this is most commonly useful and people don't really understand it. PostgreSQL is a real pearl, and few people know how much capability it has, how to use the geospatial indexing, the full-text search, how to do basic optimization and profiling. Even for people who really do large scale computations, learning hadoop or mongodb (is anyone legitimately doing big data really using mongodb?) is just an afterthought, considering how much you have to learn first about mathematics, algorithms and computing to do anything sensible at that scale at all. If you bubble sort, MongoDB won't save you. If you know the fundamentals already, you likely don't need a separate course in mongo or hadoop. For people looking to learn something more genuine, I would recommend, for example, this book: http://infolab.stanford.edu/~ullman/mmds.html http://infolab.stanford.edu/~ullman/mmds.html
- resu_nimda 13y agoAren't there already plenty of courses and books out there about algorithms, data structures, RDBMS, etc? I have a pretty good background in a lot of that (can always learn more of course), but I don't know anything about Hadoop and MapReduce (which is conveniently not mentioned in your critique, probably because it does fall under your list of acceptable topics), so I find this course interesting. I find the claim of "if you know the fundamentals, you don't need a course in that" to be dubious. Essentially you are saying that any learning material specifically targeting Hadoop is unnecessary? Don't worry though, I'm not looking for some quick fix to my business needs, I'm not going to go out and spin up a Hadoop cluster on my 500GB of production data, I just want to learn. You're arguing more against your perceived motivations of the course-takers than the validity of the course itself.
- sfeats 13y agoThis looks great, anyone know how much the program will cost?
- jackgolding 13y agoSays on the site mate, about $210 per unit
- noahmarc 13y agoThis seems like a great bundle of courses. The big data topics caught my attention but I'm actually looking forward to exploratory data analysis. Especially with the Tukey mention: https://www.udacity.com/course/ud651 https://www.udacity.com/course/ud651
- hoprocker 13y agoSo looking through this 'track', I see one course which seems like it might be more central to the discipline, "Intro to Data Science"[0]. Has anybody had a chance to compare this one against Bill Howe's "Introduction to Data Science"[1] on Coursera? [0] https://www.udacity.com/course/ud359 https://www.udacity.com/course/ud359 [1] https://www.coursera.org/course/datasci https://www.coursera.org/course/datasci