7 ms·
All MIT students, regardless of intended major, must pass two semesters of calculus, plus two semesters of calculus-based physics, as part of our General Instit
by Animats 5y ago
All MIT students, regardless of intended major, must pass two semesters of calculus, plus two semesters of calculus-based physics, as part of our General Institute Requirements. ... There is no path through MIT that does not rest on a rigorous foundation in mathematics, and we need to be sure our students are ready for that as soon as they arrive.
For a period in the 1980s-1990s, you could argue that calculus was not essential in computer science. It was all discrete math for a while. But then came machine learning, and it's all about hill climbing and gradients now.
- rossdavidh 5y agoTrue, but the usefulness of calculus to a working developer in ML is pretty marginal. The difference between different ML algorithms for hill climbing or gradients, is orders of magnitude less than the effect of having the right training data, formatted the right way. Statistics or data science is far more applicable to nearly any field on real-world programming. But, you know, like Latin in the 19th century was always still useful to one's education, calculus is still useful. It is also something a lot more people know how to teach, than know how to teach statistics (or other more useful topics). I think the latter is the primary reason it remains central to most engineering programs.
- dontreact 5y agoI disagree with this. Being able to read and understand the math in the paper of the algorithm you are implementing is useful, and calculus is common in ML papers. You may have some short term success without understanding the algorithms at all, but as the field changes and you are no longer in school, being able to keep up at least somewhat with papers is very useful. I agree that the day to day is mostly about formatting data though!
- rossdavidh 5y agoWell I took calculus, and I did a Master's thesis (much smaller than Ph.D., obviously) on neural networks, and I didn't find much application. Plus, the vast majority of work on ML is not going to be taking an ML paper and implementing it in code. It's going to be transforming this raw data into a format that the existing ML library can accept as input, selecting which cases are useful for training (e.g. making sure each important sub-case is adequately represented), and other things surrounding the data and how it is fed into the (already existing) ML library. Perhaps also playing with the options of the ML library, as to what kind of model you build. But 99% of the alterations you can make to an ML library, will not make nearly as much difference as what data you feed into it and how. If it's the right data, many ML models will work, and if it's not the right data, none of them will. But regardless, none of this requires, or even really benefits from, calculus.
- dontreact 5y agoI agree with all of this, but ML will evolve a lot over the next 30 years of your career. Being able to read the papers as the field evolves is useful, and many of the papers (especially the ones that shift the field) will assume knowledge of calculus.
- deanCommie 5y ago> Latin in the 19th century was always still useful to one's education, Was it? Or was it perpetuated by a community that happened to already know it and so they leveraged it?
- hkt 5y agoI suspect the answer is "both".
- rossdavidh 5y agoBingo.
- kragen 5y agoLatin is what almost the entire Western academic literature prior to the 19th century was written in. You may or may not know this, but Google Translate didn't exist. So, it was essential to anyone undertaking academic studies at the time (in the West) to read Latin, though not to write it. Nowadays English holds that position, despite Google Translate.
- nicknow 5y agoYes, because learning Latin - as a written language - will put your vocabulary far ahead of those who don't. My high school had a general elective focused just on learning to use Greek and Latin to enhance your vocabulary, it was essentially a free SAT prep course for the language section. So many terms can be quickly understood if you understand Latin prefixes and suffixes, and the better you understand Latin the better you'll understand its use in any of the modern Western languages.
- rawgabbit 5y agoAgree. Statistics > calculus for the software engineers. Statistics > calculus for most people doing research as their papers would need to interpret t-scores, z-scores, confidence intervals etc. I don't understand this fetish about calculus.
- rory 5y agoWell, you need at least some understanding of calculus to meaningfully understand statistics, don't you? A basic ability to intuit about integrals and derivatives seems like table stakes.
- peterhalburt33 5y agoTeaching only statistics and no calculus is how you end up with people such as Tai reinventing high-school calculus and attempting to use statistical methods to validate their “method”. https://math.berkeley.edu/~ehallman/math1B/TaisMethod.pdf https://math.berkeley.edu/~ehallman/math1B/TaisMethod.pdf
- rory 5y agoOof. Tough look to name the model after yourself. Why is this cited so many times?
- time_to_smile 5y agoHonestly every educated adult should understand calculus, and certainly anyone with a technical degree should. Sure many people will be unlikely to need to do the raw computation of calculating derivatives and integrals (even people doing machine learning are typically letting computers do that work), but to understand the way these two concepts work together and describe the world is really essential to understanding so many problems.
- david38 5y agoThis is hubris. I can think of many adults that know nothing of Calc and do very in life and work. Knowing basic accounting, being able to fix things around the house, being pleasant to work with, etc are far more important.
- simulate-me 5y ago> Knowing basic accounting, being able to fix things around the house, being pleasant to work with, etc are far more important. Those are totally useless skills. If you live in America and your only contribution to society is being pleasant, knowing how to fix things around the house, and basic accounting, then expect your livelihood to be replaced by someone willing to do your unskilled work overseas for a fraction of the cost in the very near future. Not to be harsh, but that's the reality.
- kragen 5y agoSeems like that trend will result in wages between "America" (I guess you mean the US and don't know Bolivia is in America) equalizing with the rest of the world. Also, fixing things is highly skilled work and very hard to offshore.
- simulate-me 5y ago> Bolivia Don't you mean the Plurinational State of Bolivia?
- solveit 5y agoI would argue that calculus is essential in discrete maths, but ML is not essential in Computer Science.
- flatiron 5y agoprofessional developer for close to 20 years, never used calculus. but i also a dumb java on the backend javascript on the front end web jockey.
- hkt 5y agoSome might say that's representative of the majority of the field..!
- alerighi 5y agoTo be a developer you don't even need to go to university. I know a lot of valid developers with a technical high school diploma, and I see that most of the time are better than a lot of people with a degree (or even a master degree). To this days to be a developer university must be seen just as something extra that you do if you want to occupy positions that goes beyond being a simple programmer.
- bmc7505 5y agoCalculus is not just about gradients. Fundamentally, calculus is about calculation and symbolic logic, a much older concept that predates its usage in gradient-based machine learning. In this sense, calculus holds deep connections to logical reasoning, proof theory and the foundations of computer science. [1] [1]: https://compcalc.github.io/ https://compcalc.github.io/
- sandgiant 5y agoThis. The importance of learning calculus and model building (physics) is all about learning to reason, making predictions and quantify domain validity. It's not about calculating derivatives or proving continuity. I think people take these requirements too literally.
- deleted 5y ago[deleted]
- throwawayozy 5y ago
- deleted 5y ago[deleted]
- fshbbdssbbgdd 5y agoI don’t remember the details anymore, but my combinatorics class required calculus. Something to do with Taylor series.
- kevinventullo 5y agoGenerating functions, perhaps?
- uwuemu 5y agoI would argue exactly otherwise... with the advent of the web platform and frameworks like .net, the vast majority (and I mean like 95%) of developers will never touch anything ML related in their careers. I mean, I get that this is MIT and many of their students will end up working with ML, but applying that globally to CS is nonsense. Back when I was studying CS (cze) more than a decade ago, we had to pass linear algebra, graph theory and calculus, but honestly, that was like in the first year and a half and then it completely tapered off (later years were all about projects, algorithmization, i.e. "doing the work" and very little about hardcore theory) and guess what, I never needed it again. A bit of statistics and some graph theory here and there, but that's about it. Contrary to popular belief, there are NOT that many ML jobs out there and the ones that are there are more about data science and messing with model zoo type of shit than actually coding useful programs. Most programmers will be lucky if they get to integrate inference of a prepared model into the apps they work on.
- paxys 5y agoThis is exactly why so many people (myself included) advocate for a pure "software engineering" degree at more universities. Let people who are interested study graph theory, combinatorics, linear algebra, advanced probability and statistics and whatever else. For the rest, provide a path to be ready for an industry job building websites and applications, which is what 90% of graduates will end up doing. Every other discipline out there has a clear separation of pure from applied science. Why can't we do the same for software? What we end up with is borderline fraudulent coding bootcamps to fill in the gap.
- zozbot234 5y agoSoftware engineering is based on applied mathematics too. You'll need at least some basic calculus to make sense of O(n) analysis, and Calc II as a prereq for probability. Then add plenty of logic, discrete mathematics (needed for algorithms and data structures), models of computation and concurrency, category theory (which is becoming a shared language of everything "compositional"), topology etc. etc. If you really want a "math free" intro to tech, look into Business Information Systems. That tends to be more ad hoc, at least for now. At some point, people will start to care about software assurance even in that context, and the standards will rise accordingly.
- hwers 5y agoI'd like to see 1980s-1990s graphics programmers get away with just discrete math for all the innovations they did in that period.
- __MatrixMan__ 5y agoIf we need calculus for CS, I wish we'd teach it under the CS heading so that exposure to math didn't have to be so biased towards real analysis. Students spend years achieving this arbitrary (unless you're going to be an engineer) goal and end up with the erroneous (and often harmful) intuition that all spaces are continuous metric spaces.
- hyperbovine 5y agoI don't get this take at all--learn both real analysis and discrete math. At MIT especially. Knowing calculus (the precursor to RA) is essential for quantitatively understanding the world in which we live, including the 99.9% of it that is not computer science.
- __MatrixMan__ 5y agoI think we're in a circle: I'm objecting that we teach people to map everything onto the real line and you're saying that it's essential to quantitatively understanding the world. But isn't that what "quantitatively" means? My point is that in the zoo of mathematics, the reals are just one exhibit. Equally valid is to map phenomena onto topological spaces, inner product spaces, sets, groups, rings, fields, lattices, topoi, etc... People have been standing on Newton's shoulders for so long that all they can see from there is ground well worn by their colleagues who stood on the same shoulders. I think we'd be much better off if you had to specialize in some part of math, but that different people specialized in different parts of it without necessarily taking a major in it. This would maximize the sort of happy accidents that lead to discovery because for any given phenomena you now have a wider variety of perspectives on it, rather than just a classroom full of analysts. I'm against the reals in particular because I think they're especially suited to zero sum games, and I wish we played fewer of those.
- johnnyanmac 5y agoI could agree with this. The one regret I had was burning through all my math classes within my first two years while my early CS classes barely seemed to use Algebra to begin with. Then lo and behold, turns out I like computer graphics a few years later, and all that linear algebra and multivariable calculus I skimmed through slams me back in the face as I find out that GPUS chew through such math for breakfast. I could never find the application of such math to my career track until long after I took those classes.
- vmception 5y agoand this is why trade schools like coding bootcamps are relevant at all people aren't going to school to learn computer science, they are going to school to get a job and be effective in that field, but the universities shouldn't feel obligated to adjust to that since they've been for the privileged folks who are actually there to pursue education for the sake of higher learning for nearly 200 years (or much longer). it is mere coincidence that they have to put up with a few decades of people needing the school for subsequent employment and the school will exist after this phase as well so with that observation it really is useful to push for trade schools again, for the people that actually need it for the people that are really going for that upper echelon of access to other privileged people whether they get a wage-slave job or not, yeah they should slog through MIT, but everyone else should consider other things that more closely match the lane they were born into
- bee_rider 5y agoAlso community colleges. We should fund community colleges to the point where bootcamps cease to exist.
- vmception 5y agoMaybe, I think they serve different niches But don't have to Community colleges should have electives and tracks that are similar to trade schools: getting you up to speed on whats relevant right now But as long as they are pushing towards associates degrees and transferable credits to universities I think the utility is less optimal for people looking to be efficient at a job (Also employers should be training people for what they actually need too, sparing us all from imagining that the Computer Science major is necessary to synthesize better outcomes in unknown situations)
- mirker 5y agoThere are discrete forms of “gradients” which generalize classical CS concepts. Submodular optimization, for example, covers many algorithms that search for optimal configurations of discrete sets, and it does so by arguments that are analogous to convex optimization.
- kragen 5y agoCan it approach an optimum in time linear in the number of dimensions like gradient descent does, rather than quadratic or exponential or something?
- mirker 5y agoThe greedy approach has an 1-1/e type of approximatation. You basically prove that the problem is in the class and then solve it greedily. It’s not much different than proving the problem is convex and then using gradient descent.
- kragen 5y agoPeople mostly use gradient descent to "solve" nonconvex problems.
- mirker 5y agoThere isn’t much theory on why it works in the nonconvex case. You can similarly make discrete heuristic algorithms for sorting, etc. with no guarantees. Anyway, as nonconvex models are usually stacked convex models, you can find works that incorporate these submodular functions as neural network layers.
- SamReidHughes 5y agoVery few developers work in machine learning.
- simulate-me 5y agoCalculus underpins almost every scientific advancement since its discovery. To exclude it from the curriculum at a school focused on technology would be insane.
- pishpash 5y ago90% of software engineers don't do algorithms, even in ML -- nor are they capable of, besides rote memorization of interview algorithms. Software engineering these days is mostly a job of complexity management and automation, requiring little math and more secretarial skills. That's just the ugly truth that nobody wants to hear.
- dan-robertson 5y agoI’m not sure that elementary calculus is particularly related to machine learning (I have a similar opinion of linear algebra which is fundamentally geometric in a way that machine learning isn’t). That doesn’t mean that you don’t need to know anything about calculus or matrix multiplication to understand machine learning but knowing eg Green’s theorem won’t help and neither will understanding a tensor as a multi linear map or in the way a general relativity physicist might. I also don’t particularly know what goes into calculus (in the U.K. we studied something called ‘calculus’ in high school which included integrating/differentiating polynomials, some trig functions, easy integration by parts and, in the ‘further maths’ course, some second order linear ODEs with forcing, first order ODEs via integrating factors, first order linear systems of ODEs via the eigenvectors method, and I think some integration by parts based recurrence relations. At university things were divided into ‘calculus’, which contained practical tools for applied maths like Green’s theorem or partial derivatives or contour integration or Sturm–Liouville theory, and ‘analysis’ which had foundational things like epsilon–delta stuff or Dedekind cuts or the definition of a limit or Riemann integration or the conformal mapping theorem and so on. I think a first course in the thing I called analysis above is very useful for building mathematical maturity (ie the ability to not deduce false things but also playing with definitions and thinking about counter-examples) but the calculus knowledge can be useful for understanding the physical world. But I don’t know if that understanding should be required for e.g. computer scientists. A few calculus examples I can think of in computer science: - Some famous story of Feynman ‘interning’ at Thinking Machines and solving some capacity management problem using bizarre differential equations with terms representing e.g. ‘bits per second’. No sufficiently good solutions had been found using discrete methods. - I was once asked an interview question which I suggested solving with differential equations but I was quickly directed towards not doing that. - Honestly I can’t think of many more but maybe this is a lack of imagination. I think there are a few things that are really probability theory that you need some understanding of calculus for, e.g. emergent behaviour of distributed systems, reasons to prefer random cache eviction, some intuition to answer a question like ‘if the time X takes has some distribution, but sometimes we have a gc pause for y milliseconds, how would that affect the distribution?
- kragen 5y agoIt's "fundamentally geometric" to understand that the Fourier transform diagonalizes a circulant matrix so you can estimate the clock skew between two radios? I think you get into calculus very quickly once you start dealing with uncertainty. A bit is 0 or 1, a discrete value. A random or unknown bit has some probability of being 1, a continuous value. A process that produces a random bit does too. An unknown such process has a distribution over such probabilities. Things like that are fundamental for things like communication or image classification. Also, though, a major application of computers is modeling and controlling the calculus-based physical world, just because they are so good at number crunching. Particularly popular examples are ray tracing, music synthesis, and motor control.
- peter303 5y agoCuriously, MIT does not have an university-wide computer requirement, though some departments do. They have been debating this requirement for decades.