15 ms·
Foundations of Data Science [pdf]
- blahi 10y agoThat seems more about computer science and graphs than what the average analyst would be doing.
- dandermotj 10y agoTable of Contents: * High Dimensional Space * Best Fit Subspace & SVD * Random Walks & Markov Chains * Machine Learning * Massive Data: Streaming, Sketching, Sampling * Clustering * Topic Models, Hidden Markov Process, Graphical Models, and Belief Propagation
- marcv81 10y agoHow many dimensions would you prefer your hardcopy to span?
- tempodox 10y agoI'm new to the field (which his why the book interests me), so I have to ask: Is your TOC a confirmation or a contradiction to the parent comment?
- FraaJad 10y agoThe table of contents is pretty much the core topics of serious data science (as opposed to "learn to use data science libraries in $lang in 21 days") So yes, this book that is avaialble for download from a TURING Award winner's web page IS a Computer Science book for Data Science.
- Ar-Curunir 10y agoAvrim Blum is not a Turing award winner; his father Manuel is.
- FraaJad 10y agothis book was posted on John E. Hopcroft's webpage - https://www.cs.cornell.edu/jeh/ https://www.cs.cornell.edu/jeh/ who also has won a Turing award.
- dandermotj 10y agoA contradiction - data science is the place where statistics and computer science meet but this book definitely isn't characterised as a book about computer science and graphs. From the TOCs, it is heavily based in statistics.
- tomrod 10y agoData Scientist here. I use these, often.
- anon4008 10y agohi, sorry for responding in this thread but I saw your profile and was wondering if you had contact info I could reach you at? would be really interested in learning more about your work
- tomrod 10y agoSee my profile. Edit: I'm not sure why email is not showing up. Here is an old site with contact info: https://sites.google.com/site/thomasroderick/ https://sites.google.com/site/thomasroderick/
- Noseshine 10y agoThere is a difference between Data Scientist, Data Engineer, and Data Analyst. "Data Scientist" is for Ph.D.s or sat least Masters, those are the less common jobs. At least that's the theory, we all know what happens with titles... anyway, the point is that we can safely assume that this particular article "Foundations of Data Science" refer to the actual "scientist" role. https://www.datacamp.com/community/tutorials/data-science-industry-infographic https://www.datacamp.com/community/tutorials/data-science-in... https://bigdatauniversity.com/blog/data-scientist-vs-data-engineer/ https://bigdatauniversity.com/blog/data-scientist-vs-data-en...
- spenczar5 10y agoThat would be a very useful separation. Unfortunately, job listings and titles used in industry do not separate themselves nearly so cleanly as that. I managed a "data science" team for a few years; nearly all our work is analysis. We still would call ourselves "data scientists" because it elevates our prestige within the company, which makes our results more respected and listened-to. It's a political thing, and it also helps in hiring.
- dandermotj 10y agoDoes anyone know if this is available as a hard copy?
- FraaJad 10y agoyou can use a service like printme1.com
- jimlawruk 10y ago439 pages is $22.29 at printme.1com
- infinite8s 10y agoThat's not too bad considering the content is equivalent to a first year graduate course textbook.
- zeugmasyllepsis 10y agoHeads up - you can use the promo code `print-is-good-F15` to get 10% off. I chose to get a nicer binding and with the code it came to about $23.20
- denzil_correa 10y agoNo. I attended a presentation by John Hopcroft (author of the book) and he told that China is the only place where you'd find a hard copy.
- daemonk 10y agoThe high theory stuff is great, but a significant portion of the job is being a data janitor. Being experienced and fast at manipulating data structures, recognizing patterns in text datasets, understanding common formats used in the field and just having domain knowledge in what you are analyzing should be more emphasized in my opinion.
- crispyambulance 10y agoI sort-of agree but the "data janitor" knowledge can be learned "on the job" ad-hoc and as-needed. Mastering basic theory, on the other hand, needs a coherent and structured study-plan which requires extended focus and single-minded emphasis (at least for most folks).
- sgt101 10y agoThe on the job learning of "data janitoring" may be a contributing factor to why so much janitor action is required!
- coldtea 10y ago>I sort-of agree but the "data janitor" knowledge can be learned "on the job" ad-hoc and as-needed. Logically yes. But it's amusing how many scienty types (PhDs et al) who know all the fundamentals in theory can't do such practical tasks if their life was depended on it. It's like they thought the theorems and abstract objects they've learned would never be encountered in the wild.
- Ar-Curunir 10y agoYet PhDs are disproportionately more likely to get the interesting jobs that require stats: quabts, experimental.positions at Google, etc.etc.
- brudgers 10y agoListening to Software Engineering Daily, I heard that the there is a trend toward developing 'data engineering' as a discipline that handles sanitizing the data pipeline so that data scientists can spend more time working at business abstraction layers. There's probably a scale at which that works better, two pizza data science teams for example.
- yummyfajitas 10y agoThere's a great quote by some bodybuilder. "Everybody wants to get big, but no one wants to lift heavy weights." Paraphrasing this to data science: "Everybody wants to have software provide them insights from data, but no one wants to learn any math." The top two comments here illustrate this perfectly. Anyone who is serious about learning data science will read this book and will not shy away from learning math. You can also learn about data pipelines, but that's not a substitute for what's in this book. There are also a variety of other algorithmically focused machine learning books. They are also not a substitute for this book.
- rocky1138 10y agoThis is one of the reasons that I really dislike the term "data scientist." Essentially the job is Analyst, which is something we've had for many years. It's not a bad thing, but there's no reason to embellish it into something it's not. The primary reason I dislike this term, though, is because all scientists are data scientists. Data is how the whole thing works.
- yummyfajitas 10y agoOriginally "data scientist" meant a statistician who could write distributed systems to implement their algorithm in production. Now that the term is diluted, I propose we use adopt the banking industry term "quant developer" to refer to that.
- trendia 10y agoHow about "data monkey"? At least then when the corporations post job ads and bring up buzzwords in their meetings, we can silently laugh at them.
- zintinio5 10y agoI'm sorry, but I'm not sure that you're correct that a data scientist is a statistician who can write distributed systems. Problems have been solved for decades by people with quantitative training, from well before distributed systems (or computers) existed. Very roughly, a data scientist is a person with a combination of quantitative training and some programming skills, who is able to effectively analyze (and explain) different kinds of data, be they audio, text, census information, or whatever it might be. What we call data scientists today are the engineers, computer scientists, and mathematicians of yesterday.
- qqzz6633 10y agoWow, book from Avrim Blum. Definitely worth reading.
- itissid 10y agoI was surprised to see so little attention paid to regression. Regression is quite powerful and is a powerful thing in a DS's toolkit. For example: - What is the distribution of the residuals, how does it change over time as data comes in. How Gaussian they are(or not), analyzing weird/oddities especially around the tails - What kind of features offer the most significant signal to the model and which ones are not. These skills are even applicable to SVM and other classification analysis.
- arahuja 10y agoAgree with this, simple concepts taught in-depth with lots applications and practice is very useful. Knowing 10 ML algorithms superficially will never be as good as knowing 1 with all of it's caveats.
- Jcol1 10y agoWhat sort of foundational mathematics is required to fully consume this book? I assume multivariate calculus and linear algebra?
- iaw 10y agoSkimming that's the impression I got. Discrete math is always super helpful, some rigorous stats pops up here and there, and then there are things here and there that you just need to wikipedia.
- onetwo12 10y agoYou can read similar to chapter two, high dimensional spaces, in https://jeremykun.com/2016/02/08/big-dimensions-and-what-you-can-do-about-it/ https://jeremykun.com/2016/02/08/big-dimensions-and-what-you... Also, chapter three about SVD, is in https://jeremykun.com/2016/04/18/singular-value-decomposition-part-1-perspectives-on-linear-algebra/ https://jeremykun.com/2016/04/18/singular-value-decompositio... and https://jeremykun.com/2016/05/16/singular-value-decomposition-part-2-theorem-proof-algorithm/ https://jeremykun.com/2016/05/16/singular-value-decompositio... the advantage is that you have the python code available. https://jeremykun.com/2015/04/06/markov-chain-monte-carlo-without-all-the-bullshit/ https://jeremykun.com/2015/04/06/markov-chain-monte-carlo-wi... The book seems to be interesting.
- j2kun 10y agoIndeed, the Monte Carlo post was inspired by some discussions after reading that chapter. I also borrowed and adapted a proof or two from the SVD chapter for that second post.
- onetwo12 10y agoYour Monte Carlo post is interesting, but it doesn't consider the context of markov networks, for example reading Norvig Modern IA there are good examples. There is a subtle point that having probabilities locally you must prove that the global structure is a probability and this requires some order in the vertexes to propagate the information from the root to the leafs, also Markov models can have higher degree and then they are not like random walks. Anyway, the context of matrices and eigenvalues is interesting.
- mmcclellan 10y ago"Background material needed for an undergraduate course has been put in the appendix." So just being honest, the Appendix is still rather terse and advanced for me. Does anyone have suggestions for prerequisite readings that would help getting someone prepared for this text?
- iaw 10y agoHave you taken the standard undergraduate engineering math coursework? - Calculus covering Derivation, Integration, Multi-Variate - Linear Algebra - Differential Equations (May not be relevant here) 'Discrete math' is also useful. Some of the derivations in the book you can take on faith and not fully prove out to save time, but you should feel 100% comfortable/confident with the notation used. Let me know what's confusing you and we can try to figure out what you are missing.
- laichzeit0 10y agoNo remember this is Hacker News. Most people here learned to code "in a weekend" and they can pick up a new framework "in a weekend". They also see no use wasting money on a 4 year computer science curriculum if you can just learn to program "in a weekend". Ok I'm being extremely facetious here but it still shocks me when people comment in machine learning or data science threads asking about how they'd go about picking this up but you can clearly tell they have no formal background in the sciences. I guess the only reason it angers me is because if they had just done a CS degree instead of trying to "hack it" none of this would seem like magic.
- 1457389 10y agoI'm in this category. I guess my excuse is that I did Bio instead. What's the best way to get up to speed without having to go back to school? I stopped at linear algebra in undergrad but I probably need to refresh that as well. Would appreciate any thoughts you have.
- morenoh149 10y ago
- Luftschiff 10y agoWould working through this book be sufficient to be able to start doing data science/analysis work? Some context: I did my undergraduate degree in Economics (in a pretty math intensive university), have been working in marketing for the last 2 years and want to go back to do work in something more analysis centered.
- morenoh149 10y agoI'd say it'd be plenty. You could get away without this book but for new applications or research level work with private datasets a company would really want someone that knows what's in this book.
- hadley 10y agoNo - while it covers the theoretical foundations, it doesn't give you any of the practical skills you actually need to work with data.
- deleted 10y ago[deleted]
- mizzao 10y agoDespite being familiar with most of the material here and agreeing that it is generally useful to know, I still don't know if I'd call this book "Foundations of Data Science". It feels more like "Assorted topics in algorithms, machine learning, and optimization": data science from the perspective of a computer scientist. Notably missing are causal inference, experiment design, and many topics in statistics--causal inference being one of the primary things we'd want to do with data.
- graycat 10y agoIt's a book, a real book, quite long. It has a lot of topics on applied math. Some of its main topics are linear algebra, probability theory, and Markov processes. Really, the book just touches on such topics. Usually in college each of those topics is worth a course of a semester or more. So, what the book has on such topics is much less than such a course. E.g., for linear algebra, the book gets quickly to the singular value decomposition but leaves its treatment of eigenvalues for an appendix and otherwise leaves out about 80% of a one semester course on linear algebra. Similarly for probability and Markov processes. Some of the topics the book has or touches on are unusual with, likely, few other sources in book form. E.g., early on the book has Gaussian distributions on finite dimensional vector spaces where the dimension is larger than is common. So, for the topics rarely covered in book form, the book could be a good reference. For topics such as from linear algebra, a reader might get misled without an actual course in linear algebra from any of the long popular books, e.g., Halmos, Strang, Hoffman and Kunze, Nering or more advanced books by Horn, Bellman, or others. Usually in universities, probability and Markov processes quickly get into graduate material with a prerequisite in measure theory and, hopefully, some on functional analysis, e.g., to discuss some important cases of convergence. So, the book seems to have some good points and some less good ones. A good point is that the book is a source of a start on some topics rarely in book form. A less good point is that the book gives very brief coverage of topics otherwise usually covered in full courses from popular texts. A student with a good math background could use the book as a reference and maybe at times get some value from the coverage of some of the topics rarely covered elsewhere. But I would suspect that students without courses in linear algebra, probability, etc. would need more background in math to find the book very useful. E.g., early in my career, I jumped into various applied math topics using very brief treatments. Later when I did careful study of good texts with relatively full coverage, I discovered that the brief treatments had been misleading. E.g., no one would try to learn heart surgery in a weekend and then try to apply it to a real person. Well, for applied math, maybe learning singular value decomposition, etc. in a weekend might not be enough to make a serious application. It is good to see a book on applied math try to be a little closer to real, recent applications than has been traditional in applied math texts. I'm not sure that the being closer is crucial or even very useful for making real applications, but maybe it will help.
- swordsmith 10y agoI was planning on going through Pattern Recognition and Machine Learning by Bishop, for those who have gone through this PDF, which do you think is more useful for learning data science?