19 ms·
A Software Engineer’s Adventures in Learning Mathematics
- sonabinu 12y agoAwesome! My personal experience has been that it is a lonely road but a worthwhile journey.
- bndr 12y agoI always thought that being an Engineer assumes you have knowledge of mathematics. The way this word is being used in Software ist kind of strange. "I built a blog in php, I'm a Software Engineer" - this feels kind of awkward to me.
- uncultured 12y agoI always thought that being an Engineer assumes you have knowledge of mathematics. Not really. Mostly just algorithms and procedures of some math concepts(Calculus and Linear Algebra) which roughly corresponds to the first year of North American math major.
- eli_gottlieb 12y agoUhhh... a rigorous Computer Science program usually stops one course short of a math minor.
- uncultured 12y agoCompSci is not engineering. It's almost math major, heavily on the discrete side of things.
- angry_octet 12y agoThis could not be further from the truth. I doubt my CS professors would be able to solve a PDE (or algebraic geometry etc etc). Likewise, few math professors would be able to write a parser generator (or code worth a damn). In contrast, I know engineers who live and breathe PDEs and tweak compilers to solve them faster.
- Pyret 12y agoTwo things. 1) No such thing as universal mathematician in this day and age. 2) Engineer's PDEs(algorithms) are not the same as mathematician's PDEs(theory). Same as comparing a student in China who learned English to communicate with English speakers to English majors from English speaking countries.
- Energy1 12y agoPDE's are not discrete math. CompSci majors are more interested in topics like Combinatorics, Graph Theory etc. PDE's are more interesting to applied mathematicians and physicists. I doubt my CS professors would be able to solve a PDE.. Beyond the basics, not even many math professors can do that. Math is too vast and people specialize. Strong algebraic geometers are not necessarily strong analysts or algebraists or logicians.
- jghn 12y agoIt wasn't that long ago that most schools did not have a separate CS degree, but rather it was a math degree w/ a concentration in computer science (or some other verbiage to describe the same thing)
- cmollis 12y agoNot sure it's still the case, but it certainly was for me (class of '90).
- seanmcdirmid 12y agoDepends on your school. UW CSE (a top 10 program) would be called rigorous but is not as theoretical (there is math, but nowhere near enough for a math minor).
- eli_gottlieb 12y agoI went and checked the undergrad curricula back at UMass Amherst where I went. I was incorrect: a generic Comp Sci program there stops three courses short of a math minor. The more theoretical concentrations - such as Theory of Computing, Machine Learning, or Programming Languages - teach enough theoretical content to come within one course of a math/stats minor, or even cross the line. So yes, if you take a Computer Science major with a focus on Software Engineering, you will not learn enough math to minor in math "for free". If you pick a more mathematical subfield to focus on, you should probably declare a math minor for the one or two additional courses it will take you. I made a truly stupid choice: I graduated in 7 semesters with a Comp Sci degree concentrated on PL theory without picking up the additional courses for a math minor. As a result, I'm "condemned" to learn that material independently later on. "Luckily", the Technion required me to do extra coursework for my MSc, so I've had to buck up and learn more theory. Now get off my lawn until I'm done with my highly theoretical machine learning exam ;-)!
- seanmcdirmid 12y agoMinors are mostly meaningless on your degree; but the knowledge you get from the classes is worthwhile. I took some advanced math classes but kind of burned out on it towards the end of my degree (ironic since I went to grad school immediately after). What I did notice: CS classes are easy compared to advanced math classes...man, I struggled to eek out B's in the courses when CS classes were just easy A's. If you want to do good at machine learning...electrical engineering is probably a better choice; the maths learned in EE overlap fairly well with what is needed to do ML. PL theory is quite niche, even for PL researchers.
- bndr 12y agoI would disagree, Calculus and Linear Algebra ist only the first semester usually, then it gets harder (Analysis, Statistics, Crypto)
- uncultured 12y agoI was actually being cautious. American colleges like to make sure you pay for as many BS courses as possible. Calculus 1, Calculus 2, Calculus 3... Besides, I never heard of math majors taking cryptography that early. Usually, Intro to Real Analysis, Abstract Algebra and Abstract Linear Algebra come first.
- engi_nerd 12y agoMy engineering physics curriculum required three semesters of Calculus, a differential equations course, and a numerical methods course. Notably lacking? A course in Linear Algebra, which was not required (and most in that program did not have time to take it, as the program was more like a double major with additional technical electives).
- sz4kerto 12y agoMost of us (engineers of any kind) learn quite lot of maths during uni, and most of us forget 90% of that as it's not needed in most jobs, which is a shame. The thing I have needed all the time is statistics and prob. theory, that keeps coming up literally everywhere. Calculus - not so much. If you need something, you can always re-learn it quickly. (For example, I learned quite a lot of linear algebra, but haven't used it for ~10 years, so when I had to write some 3D gfx/shader code, I had to spend like two days on quaternions, etc.)
- jackpirate 12y agoAs a machine learning guy, I can't imagine doing stats without calculus and linear algebra :)
- Chronic31 12y agoFrom sklearn import svm Done
- bigger_cheese 12y agoI find my self surprised just how often Linear Algebra pops up. A few years ago I was doing some work with Splines, trying to smooth some noisy plant data and I had to relearn matrix decomposition (LU factorisation). Every year or so since I've been ambushed by some other "stealth" aplication of linear algebra in something you'd otherwise think would not be applicable. Nowadays my old beat up linear algebra text book from uni sits right beside "C in a nutshell" and the printed GDB manual on my shelf at work.
- shangxiao 12y agoI obtained my degree in Software Engineering at a university where engineering grade mathematics and physics were mandatory subjects. It really annoys me that I spent 4 years studying this to find that other people who scrape together snippets of JavaScript & PHP feel entitled to call themselves an "engineer".
- CmonDev 12y agoWhat about assembling car parts into a car? Isn't it what engineers do as well?
- vdnkh 12y agoI'm employed as a Software Engineer now but my degree is in ECE. The engineering curriculum at my university (Rutgers) was extremely math intensive. I didn't take a whole lot of software classes but I'm glad I did take all that math. I think it's dishonest to call yourself a Software Engineer and not have an engineering degree. Semantics, but I earned the title.
- toolslive 12y agoIn some countries it's illegal to call yourself an engineer without having an engineering degree. The degree is "protected" by the government and can only be acquired from certified organizations (like universities).
- omegaoaties 12y agoCan't stress this enough- in Canada (Ontario specifically) it is a serious fine for anyone caught using the term without being certified by a professional organization.
- stygiansonic 12y agoThis is a perfect example of why the term is protected by PEO. I used to think the PEO overreaching in its attempts to protect the term/designation, but I can see why they have taken issue with the term "Software Engineer" being genericized. I applaud the effort to learn the topics of "statistics, probability, and linear algebra", but these would have been relatively fundamental courses in most software/computer/electrical engineering curricula that I've known about, and most definitely a prerequisite to calling oneself an engineer.
- bluekite2000 12y agowhat about in the US? Is there such a fine?
- mcguire 12y agoIn some states, which regulate such things. I don't know about fines, but if a gang from the IEEE or the ASME catch you wandering around wearing their colors without being a member,.... Don't go near any dark alleys.
- danielscrubs 12y agoFeel exactly the same way. Why not just call yourself a software developer? Because software engineer sounds better. Because people expect a better math foundation. Lived and breathed math for 5 years in college before I could look myself in the mirror and call myself an software engineer.
- VLM 12y agoOriginally engineering meant something like applied science for maximal profit, or something like "the accountants of the science world", which requires little if any higher math. A filter / weedout system was required because of too many students, so its turned into something else entirely and now a engineering degree often means nothing other than having passed the weedout math classes. It really shows in some new grads that don't have any actual engineering skills but are really good at calc problems.
- Mikushi 12y agoAnd that assumption is wrong. You don't need any knowledge in advanced mathematics to engineer many types of software, that doesn't make the creator less of a Software Engineer. Being an engineer means using technology, science, mathematics to solve problems. Well in many cases you don't need math to solve these problems. The word itself as no root in math either, it's based on latin for devise/contrive, sure it was used for builders at first, where math was important, but context changes. Also Software Engineer is wide and reaching, a 3D GFX Software Engineer will need some heavy mathematics to do his job and do it well, a Web Software Engineer not much, but he'll need to know a wide range of other knowledge GFX guy doesn't know (HTTP, network protocols, various languages, server technology, database technology, browser knowledge,...). It's not about being good at mathematics, it's about knowing as much as possible about the domain of knowledge your role entails, and surprise, not every one of these requires deep math knowledge and understanding. Your attitude is pure and simple elitism.
- bsdpython 12y agoI love this answer. I find technologists can often be complete snobs about their particular niche of expertise. Math, computer science, computer engineering and software engineering are each way too big for anyone to be a true expert in any of them. I find once you've spent some time learning multiple disciplines you tend to realize how little you really know and become a bit humble about your own abilities.
- vdnkh 12y ago>Being an engineer means using technology, science, mathematics to solve problems. That's called practicing engineering. An engineer is a professional practitioner of engineer. You can practice engineering all you want, but if you're not a professional (having received an engineering degree from a certified university), it's dishonest to call yourself one. Honestly, it is elitist. But those of us who obtained our degrees worked our asses off. And I personally hate when people abuse the term to mean anything that took skill. "Candy cane engineer". "Beats engineer". "Drink mixing engineer". It's linguistic prescription to make yourself sound more important/skilled.
- 12y ago
- mcguire 12y agoA great many real, live engineers that I know would object to anyone calling themselves an engineer without a lot of study of the big three: statics, dynamics, and thermodynamics; not just general mathematics. It's one of the reasons I don't call myself an engineer. (But I do get to harsh on them a bit about not being professional programmers---their code isn't pretty.) The other reason, of course, is that the "software engineer" term comes from a group of people who really wanted the respect that comes with "engineer" but realized that the big three don't get very far, software-wise. (And coincidentally didn't want to do all that icky math stuff. Not to mention much of the icky programming stuff.)
- mcmancini 12y agoStatics, dynamics, and thermo would seem to leave out EE's, wouldn't it?
- jskonhovd 12y agoNo, most ABET school's require those courses. Also, if you ever try to get your FE/EIT you will need those courses.
- mcmancini 12y agoAn intro course would hardly seem to qualify as "a lot of study".
- dsuth 12y agoIronically, EE had by far the most maths and maths-related courses of the other degrees, at my Uni. But we were still required to study those ones, along with the civil and chemical engineers.
- nadam 12y agoWell written, this resonated with me. My day job is a software engineer. At night I have started to build a speech synthesizer. I had some math knowledge before, but I need to constantly improve it. (in the territory of signal processing and everything machine learning related.)
- andyjohnson0 12y agoA related "Ask HN" from a couple of months ago: How or where to begin learning mathematics from first principles? [1] I'm at the very start of what I hope might be a similar journey, and have signed-up for a Coursera "Introduction to Mathematical Thinking" course. I'm hoping it might give me some insight to build on. The course starts in about ten days, so apprehension hasn't kicked-in yet. [1] https://news.ycombinator.com/item?id=8697772 https://news.ycombinator.com/item?id=8697772 [2] https://www.coursera.org/course/maththink https://www.coursera.org/course/maththink
- uncultured 12y agoIf anyone is interested in how mathematicians think and do proofs there are many helpful books. For example, Mathematical Proofs: A Transition to Advanced Mathematics by Chartrand and others. How to Prove It: A Structured Approach by Velleman. Learning to Reason: An Introduction to Logic, Sets, and Relations by Nancy Rodgers. Elementary Discrete Math books make for great intro to proofs and math thought: Discrete Mathematics with Applications by Epp. Mathematics: A Discrete Introduction by Scheinerman. There are tons of terrific introductory books on other subjects in math if anyone's interested.
- gradstudent 12y agoI can't agree more re Epp. Best discrete maths book by a country mile (and I've seen a few!).
- jonsen 12y agoCould you tell what makes it better than Rosen's?: http://www.amazon.com/Discrete-Mathematics-Applications-Kenneth-Rosen/dp/0073383090 http://www.amazon.com/Discrete-Mathematics-Applications-Kenn...
- uncultured 12y agoEpp's book is much simpler.
- ph4 12y agoI'm taking Discrete Math now and have both books. Epps' has much simpler explanations. I haven't taken algebra in 5 years and find that Rosen's assumes a lot more knowledge, frequently skipping lots of steps in its explanations, which can be very confusing if you are rusty in the basics.
- poikniok 12y agoIf you don't mind could you list some more books that you think are particularly great? Topic to me is not so important, as I am interested in just books that are the best in their field. Much appreciated!
- stared 12y agoFor information theory, a really recommend: Thomas M. Cover, Joy A. Thomas "Elements of Information Theory" - it starts elementarily, has direct examples, straightforward definitions and readable notation. (And first recommendation by Cosma Shalizi: http://vserver1.cscs.lsa.umich.edu/~crshalizi/notabene/information-theory.html http://vserver1.cscs.lsa.umich.edu/~crshalizi/notabene/infor...)
- henrik_w 12y agoBarbara Oakley mentioned in the text teaches the course "Learning How to Learn" on Coursera [1]. It is about the science of learning in general, not just learning math, but it is very accessible. It's only 4 weeks, and the lectures are easy to understand. I knew most of the techniques before (spaced repetition, recall, proper sleep etc), but it was still good with a review. [1] https://class.coursera.org/learning-003 https://class.coursera.org/learning-003
- icantthinkofone 12y agoThis guy claims to be a software engineer but then asks this question, "Why spend your spare time learning math, which is challenging and sometimes dry?" The question invalidates anything he has to say on the subject and makes me question his claim of being a software engineer. No self-respecting person in that position would ever need to ask that question or write an article about it. Nor is it worth wasting anyone's time to read past the first paragraph.
- brudgers 12y agoMargaret Hamilton coined the term "software engineer." Anyone not doing landing-humans-on-the-fucking-moon level work can have their claim to the label questioned under any absolute standard.
- lovelearning 12y agoAbout 2 years ago, I had an intense urge to learn linear algebra, statistics and probability in depth for much the same reasons as the author - to improve my machine learning and computer vision skills. Really glad to see I'm not the only one. I don't have any recommendations for linear algebra, but for stats and probability (which I always found intimidating in the past), Allen Downey's "Think Stats" and "Think Bayes" did the trick.
- wyclif 12y agoFor linear algebra, I'm a fan of Hoffman & Kunze. The clearest, most useful book on the subject I've used: http://www.amazon.com/Linear-Algebra-2nd-Kenneth-Hoffman/dp/0135367972/ http://www.amazon.com/Linear-Algebra-2nd-Kenneth-Hoffman/dp/...
- brational 12y agoFor LA a great place to start is http://codingthematrix.com/ http://codingthematrix.com/ For programmers with less math experience it serves as a perfect transition with which to then go into more theoretical aspects of LA.
- DennisP 12y agoA Coursera course based on that textbook, taught by its author, just started a couple days ago.
- kevbin 12y agoI'm enrolled in that class. In the introductory lecture Professor Klein shows a flowchart of the course†. This is the best course overview I've ever seen in any math class! I've spent /semesters/ in math sequences thinking "how the #@%! does this all fit together?!?!" He says: "Don't try to read it all. It's a map... It's there to help you keep track of where you are and where we're going." Every professor should do that for their course. And every department should put up a big poster with something similar: these are the subject areas you will study, how they relate to each other, and the courses that cover those areas; if you choose this specialization these are the areas you'll focus on. Put-out a mind-map of the subject area that relates to the available courses—help students start building Elon Musks' mental-hyperloop / semantic-tree. †: http://picpaste.com/Screen_Shot_2015-02-05_at_1.58.47_AM-AnXgh4C4.png http://picpaste.com/Screen_Shot_2015-02-05_at_1.58.47_AM-AnX... available on the course website: http://cs.brown.edu/courses/cs053/current/graphical-outline.pdf http://cs.brown.edu/courses/cs053/current/graphical-outline.... ††: https://www.reddit.com/r/IAmA/comments/2rgsan/i_am_elon_musk_ceocto_of_a_rocket_company_ama/cnfre0a https://www.reddit.com/r/IAmA/comments/2rgsan/i_am_elon_musk...
- henrik_w 12y agoI am currently taking a great Coursera course that is meant as a mathematics refresher course. It's called "Mathematical Methods for Quantitative Finance"[1]. As the name implies, it's meant as a foundation for financial calculations like options pricing, but a lot of it is just pure maths, like limits, derivation and integration. The lectures are quite clear and easy to follow. I did do all this math at university, but that was over 20 years ago, so I had forgotten a lot, so for me this course is perfect. But I think it can be quite useful even if the concepts a re new to you. [1] https://www.coursera.org/course/mathematicalmethods https://www.coursera.org/course/mathematicalmethods
- csirac2 12y agoMary L Boas "Mathematical Methods in the Physical Sciences" [1] has absolutely been my favorite and most-used maths text in the 9 years since graduating uni. It's like a reference manual of just about all the non-CS (i.e. continuous/non-discrete) mathematical techniques required in my career. Highly accessible. It's a little too terse in places but I prefer this style of presentation over the insane long-form verbiage in other books I've since discarded which can make even simple topics seem overwhelming: the "Boas" book gets right to the point. Edit: Calling it a mini-TAOCP of most of the maths needed for physics/EE work might be a bit of a stretch, but I've yet to see another maths text that does better as a highly readable, self-contained and compact reference. Edit2: I moved house once and thought I'd lost my copy from university. I eventually found it, and yes, I have two copies... It's that important to me for brushing off the things I've forgotten :) [1] http://www.amazon.com/Mathematical-Methods-Physical-Sciences-Mary/dp/8126508108 http://www.amazon.com/Mathematical-Methods-Physical-Sciences...
- bainsfather 12y agoIt is a fantastic book. It isn't (only) a reference book though. For me it was the best way of learning the maths used in my physics degree. The book has many worked examples, and the extensive end-of-section questions have the answers in the back of the book (for every 2nd question). This means you can learn by "reading then doing", and see if you have got the answers right - something many textbooks lack. When I try to learn from other technical books, I often find myself thinking "I wish they'd written this in the same style as Boas".
- DennisP 12y agoI see a lot of complaints in amazon reviews about the lack of answers making self-study difficult. It got me wondering...suppose there were a website for autodidacts in math and similar topics? Something where people could post and discuss their answers to exercises. It'd solve the whole problem. Would textbook publishers sue?
- jeffreyrogers 12y ago
- nabla9 12y agoUsually good books travel from English speaking world to other languages as translations. One of the masterpieces that has gone the opposite direction is: Mathematics: Its Content, Methods and Meaning (three volumes bound as one) by A. D. Aleksandrov, A. N. Kolmogorov, M. A. Lavrent'ev (18 authors total) http://www.amazon.com/Mathematics-Content-Methods-Meaning-Dover/dp/0486409163 http://www.amazon.com/Mathematics-Content-Methods-Meaning-Do... This book is really good companion for autodidacts. It's basically overview of mathematics.
- pflats 12y ago>Usually good books travel from English speaking world to other languages as translations. How do you know that?
- kryptiskt 12y agoThere are some numbers for this in David Bellos "Is that a fish in your ear?"[1], chapter 19. An UNESCO study of translations between Swedish, Chinese, Hindi, Arabic, French, German and English over a decade showed that 104,000 of the 132,000 translations made between all those languages were translations from English. [1] http://www.amazon.com/That-Fish-Your-Ear-Translation/dp/0865478767 http://www.amazon.com/That-Fish-Your-Ear-Translation/dp/0865...
- coldtea 12y ago>Usually good books travel from English speaking world to other languages as translations Yeah, no. Usually good books get translated, period. From Homer and the Bible to Pascal, Leibiz, Dostoyevsky, Godel and Einstein, good books fly the other way around all the time.
- edmccard 12y ago>Yeah, no. Usually good books get translated, period. Great books certainly get translated in every direction. But for merely good books, I wouldn't be surprised if readers outside the US consumed more books translated from English than readers in the US consume books translated from other languages.
- matt2000 12y agoHas anyone had any experiences learning different mathematical techniques using Mathematica? I was wondering if it might be more enjoyable to learn some areas without the manual arithmetic usually involved in school. Any recommendations on books or courses appreciated, thanks!
- ingenieros 12y agoThere's a pretty good Linear Algebra course currently being offered on edx.org. I just made it past week 1 with relative ease and in the next few weeks we will be using Mathematica. (Every student gets a license for the duration of the class)
- tpaksoy 12y agoAs a software developer who also started learning Mathematics for the same purpose (Machine Learning), I just could not do it with books. It is strange to explain, but I need someone with me to study. I need that person to say: "I don't understand it". Even if I don't understand it myself, as I try explaining it to my study partner, it starts clicking in my brain. I suddenly start to understand these parts as I'm explaining it. Hands down the best way for me to learn: explain to others.
- jpitz 12y agoMaybe you could use a duck. http://en.wikipedia.org/wiki/Rubber_duck_debugging http://en.wikipedia.org/wiki/Rubber_duck_debugging
- olavgg 12y agoI took Andrew Ng's Machine Learning course on coursera together with a friend. I had the software engineering skills, he had the math skills. Together we strived through all the excercises with a lot of discussions, helping each other and of course we had some disagreements which we learned even more from.
- pjmlp 12y agoI don't get the title. At least on my home country, a Software Engineer job title implies a CS degree with at least two years full of math.
- coldtea 12y agoIn real life, a software engineer can finish his studies and get a job with only a tiny knowledge of math, in every country, regardless what the curriculum says...
- sklogic 12y agoWell, it's a bit of an abuse of the term "engineer". It's really sad to see how software people first abducted it, and then degenerated it to a near obliteration.
- pjmlp 12y agoTell that to the HR guys or the order institution that validates university degrees and who is allowed to sign projects.
- coldtea 12y agoWell, I've seen software engineers with masters degrees that can't math their way out of a paper bag. In several countries. And, "validated university degress" or not, I doubt a fizz buzz interview would have much different results in your country as opposed to the US: http://blog.codinghorror.com/why-cant-programmers-program/ http://blog.codinghorror.com/why-cant-programmers-program/
- stared 12y agoFor general introduction to mathematics, there is R. Courant "What is mathematics?" https://en.wikipedia.org/wiki/What_Is_Mathematics%3F https://en.wikipedia.org/wiki/What_Is_Mathematics%3F.
- sshillo 12y agoSolving fibonacci using eigenvalues [1] was posted a few days ago. A great example of how powerful math can be. [1] https://news.ycombinator.com/item?id=8980546 https://news.ycombinator.com/item?id=8980546
- decasteve 12y agoThis topic comes up every so often. I think my previous comment applies here [1]: I started a Math degree after 16 years of programming without any Math beyond high school (the highest being high school calculus). Most of my work as a software developer didn't require any "higher" Maths. Once I began studying math, including Modern Algebra, Analysis, Graph Theory, Category Theory, etc., I realized I understood many topics on an informal level, in a non-rigorous sort of way, through programming. I had a good sense of major algorithms and data structures as well as their running times. Once I did have more math under my belt, things did become easier, and I started to see connections and commonality between problems across different domains, i.e. more than one way to skin a cat. Part of the reason I began studying math, is that I felt it was my limiting factor. The range of problems I could tackle as a programmer was limited by math. It turns out this was partly true. The biggest misconception is that in Math there is one "correct" answer. This is almost never the case. Some of the most interesting solutions in Computer Science come directly from Math topics that were once considered "abstract". Likewise, some of the most interesting problems are solved through approximation algorithms of seemingly intractable problems, often requiring a bit of "hacking" and real world experience beyond what you'd get from a formal education in Math or Computer Science. [1] https://news.ycombinator.com/item?id=7104566 https://news.ycombinator.com/item?id=7104566
- eric_bullington 12y ago> The range of problems I could tackle as a programmer was limited by math. It turns out this was partly true. Would you mind expanding on this? I've often thought about going back to school for a math degree, or at least for the core degree courses. Did functional programming, particularly in a pure language like Haskell, become easier to reason about once you had studied Category Theory in depth?
- deleted 12y ago[deleted]
- eli_gottlieb 12y agoYou can actually go the other way around, from functional programming to mathematics: http://homepages.cwi.nl/~jve/HR/ http://homepages.cwi.nl/~jve/HR/
- mrcactu5 12y agooriginally a die-hard math major and now, hacking and dealing with hackers, I have and to question the foundations of my own subjects. I have come to some tentative conclusions: computer science is computer program, when you abstract away all context so it is just a bunch of symbols statistics is mathematics applied to the "real world" data, and the art of turning it into form suitable for computer. Actually, from Lao Tzu's "Art of War", he put's it this way: In respect of military method, firstly, Measurement; secondly, Estimation of quantity; thirdly, Calculation; fourthly, Balancing of chances; fifthly, Victory. a solid 2000 years before the computer.
- jxm262 12y agoI don't mean to go off track here, but as someone who's been casually interested in math, I'm wondering which branches of math are the most applicable to software development. I've taken Discrete Mathematics, Stats, and Calc in college, but now I've been working in the field for a few years and want to try learning a bit more. I've been thinking of trying some courses on Cryptography, but it would be a major shift from my current background (web dev). I feel like there's so many different directions to take, but which ones are the most applicable to practical Software Development? Particularly in the realm of Web Development? Editing my question to ask what's the most applicable math subjects regarding the _PRACTICAL_ applications of software development, hopefully clears it up a bit.
- ibebrett 12y agoI feel like that might be the wrong question. If you wanted to really study formal computer science you could learn things like model theory. If you want to study the analysis of algorithm run times you may want to study something like complex asymptotics. Do you want to study math for computer science or do you want to study math that helps in most applications of computer science (graph theory, linear algebra, etc etc).
- jxm262 12y agoThanks for this. Edited the question a little to hopefully clarify things. I'm mostly going back to Coursera just out of pure curiousity, but was hoping I could take something that has some relevance to my career in Web Development (practical side, so more of your latter statement). Sounds like Linear Algebra would be good to learn.
- nharada 12y agoComputer science is pretty broad. What do you want to do? Just because I use linear algebra all the time for machine learning doesn't mean it will help you (that much) with computational complexity analysis.
- aidos 12y agoLinear Algebra is definitely one you can make use of. When I studied it at uni I did it from a mathematical standpoint and only some years later discovered how useful it is in computing. Have you done any study of Graph Theory? I've found that a surprisingly large number of problems in computing can be morphed into graphs. I was working on an issue last week (in a web app) that turned out to be a variant of Exact Cover which straight away gave me a large body of literature / algorithms to pull from - and told me I was in a slightly dark place :). Graphs and the algorithms around them feel very close to the work we do with computers, so it will probably be pretty approachable given your background. My advice would be to not worry too much about how applicable it will be to web development and just pick something to study. Ultimately, it will end up being useful in time. And maths is just beautiful.
- bitL 12y agoWhat I understood after studying CS for over 10 years at a few universities regularly ranked highly at ACM ICPC is that math is unnecessarily obfuscated to most people. There is even an excellent book "Concrete Mathematics" from Stanford that tries to bring fun back to math instead of drying people with some formal stuff without explaining how people over the centuries got to that structure. I honestly believe math language is seriously outdated. It's like using COBOL to express everything. Yes, you can do that, but would you really want to given a choice? The most trivial things are so insanely complicated in math it's unbelievable (try to describe geometrical objects with the current math formal language if you do computer vision), yet there is very little work on developing better formal language of math. It's like with Turing machines and the complexity theory - who is going to move around a tape in the real world besides some specialized biological systems, not mentioning magical 'oracles'? Those abstractions were useful in their day, brought their fruits, but why do we still stick to them and just increase the gulf between more and more closed-unto-itself-theory and reality? Yes, it's great some theory is super cool but what do we do when we find in 20-30 years that the set of objects satisfying this omnipotent theory is empty? And when somebody like Mochizuki invents their own formal language to solve some cool problem like ABC conjecture, we all hate him, refusing to read the proof because it doesn't follow our outdated formal ways...
- jeffreyrogers 12y agoI agree strongly that math is poorly taught most places and that Concrete Mathematics does an admirable job of teaching math in a way that gets to the beauty of it. Oddly enough, it wasn't until I threw myself into more advanced mathematics that I started to see the fun in it. I absolutely hated learning calculus and linear algebra even though I could do it well. It just seemed so boring. I don't have a good solution to how to make things better, however, the mathematician Paul Lockhart has given this a lot of thought. All that said, I think there are a number of misconceptions here. First, mathematicians invent new languages all the time. That's the point of definitions, otherwise we'd be using sets to describe everything. The problem is, you first have to understand the concept well in order to apply suitable definitions. Think probability before Kolmogorov. Second, Turing machines are a formalism to introduce you to the theory of computation because they are the simplest (or close to it) thing that can compute in the current sense of the word. Once you learn how TMs work, pretty much everyone just accepts them as a given and deals at a higher level. Third people are trying to read Mochizuki's proof, but it is very hard. He basically invented his own way of doing things and so to understand his proof you first need to understand his methods. It's understandable that professional mathematicians with their own careers and areas of research find it hard to read the ~1000 pages of dense mathematics (proof + prior papers) to understand what is going on. Most people probably haven't read 1000 pages of math in their life, and it takes a while to come to terms with it no matter how smart you are.
- peter303 12y agoI didnt really learn math until I had to use it in my work. For example my thesis worked used a lot of complex analysis and wave equations. I had had those in Physic and math calss, but really didnt obtain full understanding until using it.
- agentultra 12y agoAwesome. Good for you. Keep at it. Keep a journal. Share with others what you learn. Learn from others when they share it. I'd add a few of books to your list: Graph Theory by W. T. Tufte: http://www.chapters.indigo.ca/en-ca/books/product/9780521794893-item.html?s_campaign=goo-PLATest&gclid=CJuA6sbJz8ECFY5cMgodV0MAiA http://www.chapters.indigo.ca/en-ca/books/product/9780521794... On Numbers and Games by John H. Conway: http://www.amazon.com/On-Numbers-Games-John-Conway/dp/1568811276 http://www.amazon.com/On-Numbers-Games-John-Conway/dp/156881... And for good re-introduction to geometry and it's practical application to computer graphics: http://www.amazon.com/Primer-Graphics-Development-Wordware-Library/dp/1556229119/ref=sr_1_sc_2?ie=UTF8&qid=1423062954&sr=8-2-spell&keywords=3D+math+primerp http://www.amazon.com/Primer-Graphics-Development-Wordware-L... I think maths is amazing. It's a useful tool to have in one's arsenal regardless of your profession or walk in life. It's also not the sole domain of the highly educated elite. Anyone can do it. It's not important to be "correct" all of the time so much as it is to be curious and willing to learn -- and willing to share. Keep at it! There's so many cool things you can do as you learn more!
- otoburb 12y agoThank you for the recommendations! The author for Graph Theory is W. T. Tutte, not Tufte, and much appreciate the link which helped clear up my initial confusion.
- nandemo 12y ago"On Numbers and Games" is a great book but it can be tough. "Winning Ways for your Mathematical Plays" by Berlekamp, Conway & Guy is a gentler introduction to surreal number. It's also very fun.
- manish_gill 12y agoI've been doing project Euler problems and I realise it really really helps to know Number Theory to get to an optimal solution for problems. Can anyone recommend good books on the subject? While learning via problem-solving is fun, most of the time it boils down to me sitting with a naive, brute-force solution that's too slow and then google how to make it fast, discover a new number theory axiom/tool and then changing the algorithm. There's gotta be a better way to learn...
- pakled_engineer 12y agoMIT OCW has plenty of number theory courses up from beginner to graduate level. Serge Lang has a good book on Number Theory as well. http://ocw.mit.edu/courses/mathematics/18-781-theory-of-numbers-spring-2012/ http://ocw.mit.edu/courses/mathematics/18-781-theory-of-numb...
- brudgers 12y agoI lost interest in mathematics starting in tenth grade. Looking back into the haze, it wasn't so much mathematics as high school in general and by extension industrialized education. Boredom begat indifference. Chaos reoriented priorities across starts and fits with mathematics in post-secondary education. I enrolled in Coursera's Discreet Optimization about a year ago. It was way beyond my ability [No SoA], but I learned a hell of a lot about computing and solving hard computational problems. It also suggested that mathematics might be important when grappling interesting problems. For fun I watched a number of Strang's Open-Courseware videos on matrices. I hit Chapter 1 of TAoCP. I treated it like programming - it was ok to only partially understand. I took an Algorithms MOOC or two. I actually enjoyed following the analysis even formal analysis is not something I would do for pleasure. The turning point though was when Lamport's "Thinking for Programmers" [Lamport: Thinking] hit HN. It threw down the gauntlet. Specification is a prerequisite for a commitment to getting it right, where the it is computing. And when the it is computing, we are talking about math whether we like it or not. It's not that the math and specification replaces testing. It's that tests are ad hoc without a mathematical understanding of the computation. [Lamport: Thinking] http://channel9.msdn.com/Events/Build/2014/3-642 http://channel9.msdn.com/Events/Build/2014/3-642
- DennisP 12y agoI just started this Coursera linear algebra course designed for software engineers, which looks really good: https://www.coursera.org/course/matrix https://www.coursera.org/course/matrix So far it tracks the matching textbook pretty closely. The first little set of lectures covered the first 62 pages.
- Bjorkbat 12y agoThe comments are amusing. It seems there's a popular opinion that to be an engineer requires a higher understanding of mathematics than what most mere mortals require. My understanding was that to call yourself an engineer one must be capable of building robust and efficient things, whether that thing is a plane, or a bridge, complex software, even a website, matters not, so long as it is robust and efficient. The degree to which you understand mathematics is useful only in how greatly it can enable you to build something robust and efficient. Thus, if you know more linear algebra than 90% of all mere mortals, but write inefficient programs, then at best you are a bad Software Engineer, at worst you're simply not a Software Engineer. For that reason, at my current job I was asked to replace a man who earned his PhD in Computer Science from Georgia Tech who's job was to build an maintain an API in Go, despite the fact that I'm a college dropout. Smart man, with a far better understanding of mathematics, but ultimately I could build things more robustly and efficiently. I had stronger engineering skills. Going back to OP, right on man. I personally didn't enjoy math until I learned it using my own rules, by own rules I mean I shunned the established method of repetition until you memorized the process, instead opting to understand the underlying concept and keep my thoughts written away somewhere for future reference, knowing all too well by now that memorization is futile given how frequently I have to reference Stack Overflow.
- j2kun 12y ago> It seems there's a popular opinion that to be an engineer requires a higher understanding of mathematics than what most mere mortals require. > build an maintain an API in Go Unfortunately, a much larger proportion of engineering jobs require mathematics than you make it seem. Software engineers seem to forget that engineering includes designing planes, bridges, cars, lasers, electrical circuits, materials, and a million other things that require you know mechanics, statics, statistics, logic, linear algebra, differential equations, etc.
- Bjorkbat 12y agoI clearly brought up designing planes and bridges, I figured both were enough to demonstrate that my definition of engineering includes the structural, the mechanical, the electrical, etc. The point is, the engineer who designs the plane only needs to know enough math to design said plane. The engineer who designs the bridge? The same. Theoretically, they're supposed to understand a great deal. Realistically, the degree to which technology automates the mundane task of calculation could very well mean that their daily application and actual understanding of mathematics is overestimated anywhere from slightly to greatly. This will be especially true as time goes on and the tools of the trade become even more advanced. To design a web application that operates efficiently in terms of cost, response time, and required maintenance, along with a number of other variables, requires good software engineering. Once upon a time, this required strong mathematical aptitude. Now, it requires more of an understanding of the language used for the design of the application itself, an ability to justify why one approach should be faster through algorithm analysis and efficient testing, logical thinking, etc, it certainly doesn't require the mathematical aptitude to design your own cryptography protocol whenever you can simply use a library demonstrated to be safe and reliable, although an understanding of the underlying concepts of how said protocol works might be nice, if anything to understand why you shouldn't roll out your own. It's not too far off to imagine a near future where the average <insert engineer here> functionally requires the same degree of mathematical aptitude as today's current web developer.
- aethertap 12y agoI am doing this too, with Macdonald's "Linear and Geometric Algebra" and "Vector and Geometric Calculus" along with "Networks, Crowds, and Markets" and "Chaos and Nonlinear Dynamics." It's slow going, but very enjoyable. The most interesting side effect I've noticed from doing this is a dramatic improvement in my ability to focus. I had been suffering from a general scatterbrained, distracted feeling for a while before I started. I think it was due to the way I consume content online, trying to follow too many interests at once. I set aside about an hour a night to work on these math courses and within a couple of weeks I noticed that my focus was greatly improved. For that reason alone I'm counting this project as a major win, regardless of whether I master these topics or not. Having something to study seems to be extremely valuable for general mental health, at least for me.
- mcguire 12y ago"Get your fundamentals on lock so that you can start getting into the ill advanced shit. This is universally applicable. — Earl Sweatshirt" "ill advanced shit"? I know, I know, it's a quote and probably intended to be funny. Heck, it might be. But I swear, if I start hearing people say that without an awful lot of irony, I'm going to be kicking people in the testicles.
- jonathantm 12y agoDude... have you listened to Earl? He can put out a tape every 4 fours and STILL have shit on lockdown. Yo.
- otakucode 12y agoWhen I pick up a book and start to learn something new (which is pretty much what I do in my free time), I usually do it with an IDE at hand. I try to implement as much of what I learn in code. If I can teach the computer how to do it, then I am sure I really understand it, and it often helps me find holes in my understanding. I have significant trouble with doing this with mathematics, though. Programming languages (at least the ones I know) just don't seem to be good for expressing things like identities and invariants. Anyone have any suggestions on how to handle such things?
- calebm 12y agoI can personally strongly recommend the book, "Who is Fourier?" for learning math: http://www.amazon.com/Who-Fourier-Mathematical-Adventure-Edition/dp/0964350432 http://www.amazon.com/Who-Fourier-Mathematical-Adventure-Edi.... It is the best math book I have ever read.
- gtani 12y agoI read this the first time posted (didn't get any comments), very poignant, especially the part about relearning trig/geometry, precalc. There's boundless resources for learning now but you don't get little endorphin/epinephrine releases like you do when your gcc/clang/VS compile succeeds, it's still mostly notebooks, whiteboards, pencils and 4-color pens (tho i've seen lots of cool JS animations, ipython notebooks, and libs in R, matlab/octave and now julia) - a few universities have put (many/most) of lecture notes and student notes up: http://www.maths.cam.ac.uk/studentreps/res/notes.html http://www.maths.cam.ac.uk/studentreps/res/notes.html as well as study guides: http://www.maths.cam.ac.uk/undergrad/studyskills/text.pdf http://www.maths.cam.ac.uk/undergrad/studyskills/text.pdf - books about how to think like a mathematician: Keith Devlin, Kolmogorov/Alexandrov et al did 2 Dover books, and Houston: http://www.amazon.com/How-Think-Like-Mathematician-Undergraduate/dp/052171978X/ http://www.amazon.com/How-Think-Like-Mathematician-Undergrad... and http://www.amazon.com/How-Study-as-Mathematics-Major/dp/0199661316/ http://www.amazon.com/How-Study-as-Mathematics-Major/dp/0199... and Ellenberg: http://www.amazon.com/How-Not-Be-Wrong-Mathematical/dp/1594205221 http://www.amazon.com/How-Not-Be-Wrong-Mathematical/dp/15942... - Concrete Math by Patashkin, Knuth et al; Streetfighting Math by Mahajan and his newer, freely available: http://mitpress.mit.edu/books/art-insight-science-and-engineering http://mitpress.mit.edu/books/art-insight-science-and-engine... - this machine learning/data science list: http://www.reddit.com/r/MachineLearning/comments/1jeawf/machine_learning_books/ http://www.reddit.com/r/MachineLearning/comments/1jeawf/mach... - Cal newport blog: http://calnewport.com/blog/2012/10/26/mastering-linear-algebra-in-10-days-astounding-experiments-in-ultra-learning/ http://calnewport.com/blog/2012/10/26/mastering-linear-algeb... - besides Dover, Schaum Outlines are a good cheap resource abundantly available in used bookstores(tho there are in fact some type-ridden ones also) ____________ the best advice general advice i've seen is the same as what they tell you in college: form study groups and make commitments to regular discussion. Stronger students strengthen their understanding by tutoring others at the whiteboard. There's lots of machine learning and data sciencey meetups and informal groups springing up e.g.http://machine-learning.meetup.com/ http://machine-learning.meetup.com/
- aswanson 12y agoI hated math from elementary up until i learned Fourier theory. That was a pivotal moment in my education ; math went from wrote excercise to pure beauty in a single lecture. Now im trying to self learn lie algebra. I need to find out what prerequisites i need. A ton of math at this level is notation and terminology.
- JoeAltmaier 12y agoFor me it was vector algebra. I was trying to write space games with real motion, and that was the key to efficient code.
- bholzer 12y agoSame here. Linear Algebra is what got me from "math is boring, and I only learned things to pass a test" to "math is really cool, and can actually solve these problems in real life"
- tel 12y agoGiven everyone recommending books for math autodidacts interested in learning the "breadth" of mathematics, I cannot recommend more highly Saunder's MacLane's "Mathematics, Form and Function". It reads as a high level false-historical account of how math might have been developed, in its entirety, if it unfolded in the most direct and logical way from the human experiences we all share (guided by understanding of where mathematics has ended up in the modern age). The false-historical expose is fantastic. The goal becomes less to express things as accurately and comprehensively as modernly possible—which you'll experience as you take on graduate level books or modern papers—but instead to demonstrate large-scope intuition for why whole fields evolved as they did and how they are all intermingled.
- marai2 12y agoGoing back to the "breadth" recommendations, if someone wants a real appetizing sushi sampler of the breadth of Mathematics, I would highly recommend "The Joy of X" http://www.amazon.com/Joy-Guided-Tour-Math-Infinity/dp/0544105850 http://www.amazon.com/Joy-Guided-Tour-Math-Infinity/dp/05441... It covers a number of topics in Mathematics and makes them really easy to follow for someone with no background in Maths. I especially liked how in a few pages I succinctly understood div, grad and curl from vector calculus. For anyone wanting to start out on a full course meal of Mathematics this would make a very appetizing sampler.
- bradneuberg 12y agoGreat article. I've recently been self-teaching myself machine learning the same way. I found that it started to get difficult in the middle of the course staying on track. I decided to "scratch an itch" in open source parlance and start a study group I call colearning. Colearning provides a place for people doing remote education (or working on their own projects or writing) to have structured time to study and move forward towards their goals. It helps provide the positive pressure that a real physical class provides. Our colearning group currently meets at Borderlands Books in San Francisco on Sunday's from 11 am to 4 pm. Message me and you can come join! I've done this to help provide the structure I need to keep learning; its already helped me advance greatly in my own studies as I make forward progress every week. Years ago I also identified a need for community while being self employed and started the coworking movement.
- graycat 12y agoPart I -- General > Why not quit my job and go back to school? Well, that’s not really for me. Reading books at my own pace lets me try a subject out without fully committing to it and making it a necessity that I find work based off of it. I respond here in three parts, the first general, the second more specific and about linear algebra, and the third about statistics. Really, in school, you still have to learn the stuff. And, there a class might help but won't be enough; so, right, again, during the course and in the hours not in the class, you still have to study and learn the stuff. Or for the class, "mathematics is not a spectator sport". That means you still have to study the stuff, get it between your ears, understand it. Eventually you can conclude that mostly college and its courses are more for certification than education. For the education, that's heavily up to you. But there are some dangers in self learning: Not all the ideas and learning materials are good; the really good ones are only a small fraction of all the ones you will likely encounter. So, in praise of college and profs, they can (1) get you on a good track with good ideas and learning materials and (2) get you unstuck and keep you on track. In such study, it's possible to do too much or too little -- from some experts you can see about what is the right amount to do. I said "college"; revise that to read "one of the world's best research universities", say, in the US, 1-2 dozen. The ideas and materials you will see in such a university really do stand to be better than nearly all you will encounter otherwise. Such learning is where there's not much substitute for quality. But, still, just to learn the material, you don't really have to enroll in such a university and, instead, just borrow from their course descriptions and materials. Indeed, some of the best such universities are working hard to make their learning materials available to all for free over the Internet. Why? Because those universities want to concentrate on pushing forward with research. Here's a way: Show up at such a university and appropriate department, in your case, applied math, mathematical sciences, operations research, statistics, whatever. Maybe show up at some public department seminars. Talk with some of the students. Say you have a career going, for your career are interested in what the department is doing, and want to learn more about the program and the mathematical content. So, get some of the students to talk and explain. Then for some of the courses you are interested in, see who the profs are and look at the course materials, say, texts, handouts, on-line files, etc. Then after looking at the materials and, say, have made some progress with them, try to get 15 minutes to chat with a prof. Then take what you just got from that department for free -- broad directions, what they regard as more/less important, texts, course materials, etc. -- and go off and study on your own. When you think that maybe you have some course studied well, try to get a copy of the course final exam or Ph.D. qualifying exam, work through it, and, if it appears you did well, ask a prof to check your solution to a few of the most difficult questions. If your solutions look good, then you will start to look good and may get asked if you would like to apply as a student in the department. So, here you and the prof and department are interviewing each other. Such things worked for me: (A) In my career I kept running into the work of John Tukey at Princeton and Bell Labs. So, it was stepwise regression, exploratory data analysis, power spectral estimation, convergence and uniformity in topology, his statement equivalent to the axiom of choice, etc. So, I wrote him at Princeton asking about graduate study, mentioned those topics, and got back a nice letter from the department Chair basically inviting me to apply. (B) I applied to Cornell and got rejected. But largely independently I visited a prof there to discuss optimization, asked about being a grad student, and soon got another letter accepting me to grad study. (C) At least at one time, the Web site of the Princeton math department said, "Graduate courses are introductions to research by experts in their fields. No courses are given for preparation for the qualifying exams. Students are expected to prepare for the qualifying exams on their own." or some such. Lesson: In grad school at Princeton, are still expected to learn the qualifying exam materials on your own. Well, to do that, don't have to be in the high rent area around Princeton, NJ. When I did go to grad school and got my Ph.D., what really saved my tail feathers was what I had done and did on my own as independent study. Some of the courses helped in providing high quality directions and materials, but the real work was nearly all independent. And, one of the crucial inflection points was when I took a problem in a course but not solved in the course, did some research, and found a solution. The solution was novel, and word spread around the department quickly. My halo got a high polish, and that greatly eased my path through my Ph.D. That is, I had proven results on the most important research academic and Ph.D. bottom line -- I'd done good, novel, "new, correct, significant" research. Then my hair cut or lack there of, sloppy hand writing, occasional upchuck at some bad course material, etc. no longer mattered. My research looked publishable, and it was -- I did publish it later, in one of the best journals, easily, no revisions. So, lesson: That inflection point was from independent work. So, don't feel that your independent work is inferior to enrolling as a student. Instead, in the best universities, as a student, nearly all the work is for you to do independently anyway. Still, I'd repeat -- try to pick the brains, for free, without hurting your present career, of the courses, profs, and materials at a world class department in a world class research university. Why a research university? World class research is a very high bar and some of the best evidence of good expertise, insight, and judgment in the field -- and you don't want the opposites.
- jafingi 12y agoMath is really important for SE's. I had multiple courses in discrete mathematics when studying MSc in Software Engineering. I love math.
- praveenhm 12y agoI am software engineer for last 10 years, I am interested in Phd in statics/Math and live in silicon valley. what is the starting point for any courses or degree, any recommendation would help.
- grecy 12y agoIt's interesting someone who studied Software Engineering didn't get a solid math education at university. I studied Software Engineering, and am a certified engineer. I sat next to the Aerospace, Chemical and Mechanical engineers for all 4 years of "Engineering Math". (They did crazy physics and chem that I didn't) How can you call yourself a "Software Engineer" without having studied a huge amount of math?
- ivan_ah 12y agoI like the author's attitude---math really is power[1], and everyone can get into it. Also reviewing high school math was a good move... Another thing that can help a lot is using a computer algebra system to solve tedious arithmetic steps or to verify one's calculations[2]. [1] http://nobsgui.de/ http://nobsgui.de/ [2] http://minireference.com/static/sympy_tutorial.pdf http://minireference.com/static/sympy_tutorial.pdf
- mdn0420 12y agoDo you have issues remembering what you learn? Sure, we've all studied these topics before in school but have forgotten since. I brush up on some geometry or linear algebra every now and then for work. But I'm sure I'll forget if I don't use it after a year or two. Are there any projects you maintain to keep your knowledge fresh?
- soroushjp 12y agoThe article title could be "Why and How to Learn On Your Own" and the points it makes are absolutely correct. Constantly find new things to explore and learn, and never be intimidated by just how daunting those things may seem.