9 ms·
Introduction to Differential Equations (2008)
- softbuilder 8y agoTangental anecdote: Every time I see Diff EQ mentioned the first thing that pops into my head is the number 11. That's the score of my first, last, and only Diff EQ test. 11%.
- bluGill 8y agoI think I got 19% which put me well in the top half of the class...
- make3 8y agohad you studied at all? most undergrad differential equations classes are fairly mechanical in nature, you just learn to identify the type of problem, then you follow the steps exactly as they are written in the textbook, super little variation or freedom
- btrettel 8y agoThis is often more true than many believe. But in my experience few students get so far that they recognize the patterns and can respond in the way you describe. That might be the crux. I remember my undergraduate mechanical vibrations class. Every exam was basically a test of how well you could do the Laplace transform on some linear ODEs. I memorized the most common transforms, so this became fairly straightforward and fast for me, but it was obvious the other students were struggling. If I had a problem that wasn't solveable with the Laplace transform, say a linear ODE with variable coefficients, I'd likely take longer to do the exam, but those never appeared in the class.
- mehrdadn 8y agoWhy is this on top of HN? There are so many websites teaching introductions to differential equations. Is there something interesting about this one in particular?
- DavidSJ 8y agoPaul’s Online Notes are a pretty well-known calculus and differential equations reference. IMO they’re pretty decent.
- zavi 8y agoPaul's Online Notes is my childhood. There's something nostalgic about seeing this submission.
- deepnotderp 8y agoThey're pretty much the best calc notes I've seen, was very useful a few years ago
- acjohnson55 8y agoDiffEq seemed like black magic to me when I took it as a freshman in college. They basically just taught us the recipe bag for solving equations in different shapes, but very little insight. When I started a gamified music discovery company, I actually ended up using DiffEq to define a scoring algorithm that would produce continuously varying point values based on time series input data. I had to relearn how to do it, but the concepts made far more sense with a real application.
- craig_asp 8y agoYeah, it's relatively dry material which is hard to grasp without the context of why we need it and how it can be applied in the real world. While the intro is good, it still has the same problem - just shows (in a good way) "some math".
- llamaz 8y agoI think the calculus of variations might be a better approach to introducing ODEs in first year. You can show that by generalizing calculus so the values are functions rather than real numbers, then trying to find a max/min using the functional version of dy/dx = 0, you end up with an ODE (viz. the Euler-Lagrange equation). This also motivates Lagrange multipliers which are usually taught around the same time as ODEs. They are similar to the Hamiltonian, which is a synonym for energy and is derived from the Euler-Lagrange equations of a system. Of course you would brush over most of this mechanics stuff in a single lecture (60 min). But now you've motivated ODEs and given the students are reason to solve ODEs with constant coefficients.
- whatshisface 8y agoYou don't need a Lagrangian to invent mechanical ODEs. You could talk about mixing tanks, objects under complicated forces, and so on with a lot less background information.
- cgriswald 8y agoWe had a great professor and this was one of the most enjoyable classes I've ever taken. One particular assignment was a group paper where we were supposed to essentially explain and use the SIR model. We extended the model to an SIRZ model and effectively argued that zombie apocalypses in fiction are essentially impossible unless they include some supernatural elements. Under a wide range of assumptions (e.g., zombies rot/zombies don't rot) the infection always stopped before it spread significantly. (We got an A.)
- budadre75 8y agoDoes anyone know any website similar for advanced linear algebra and probability with practice problems explained with detailed solutions step by step? I know there exists other great textbook like Strang's, but I often find textbook based learning resources lacking because of lack of detailed solutions.
- BlackFly 8y agoNot really a website, but I believe you can find ebooks online... I highly recommend Numerical Linear Algebra by Trefethen. It gives very detailed descriptions of particular interpretations of the singular value decomposition and eigenvalues, it works out detailed algorithms for LU factorization, eigenvalue/eigenvector decomposition, QR factorization etc. If you know basic linear algebra, the book is a pleasure to read through. For this crowd of people it is also very practical. I don't know a good resource for probability... it is a much more diverse subject than linear algebra (which is a very small, very detailed subset of algebra).
- dagw 8y agoNot a web site, but the book One Thousand Exercises in Probability by Grimmet and Stirzaker is just what it sounds like. 1000 practice problems with solutions. It's a companion book to their text book Probability and Random Processes which I think is one of the better introductory textbooks to probability theory
- vonseel 8y agoWow, it's been a while. Does anyone actually use this stuff after college???
- nanofortnight 8y agoYes? Very common in Engineering disciplines, for example.
- pbhjpbhj 8y agoIMO that's a well made question, I think it's good to ask to. https://news.ycombinator.com/item?id=18182657 https://news.ycombinator.com/item?id=18182657 is an example ITT WRT computer game writing.
- ballooney 8y agoThis is why people suggest that terms like 'software carpentry' more accurately capture what 99.5% of programmers do than 'software engineering'.
- deleted 8y ago[deleted]
- simooooo 8y agoLost me at (2)
- Sean1708 8y agoThe course overview is here[0]. I haven't looked at how in-depth the later sections are, but I can't think of a topic related to differential equations that I used in my undergrad physics degree that isn't at least touched upon here. [0]: http://tutorial.math.lamar.edu/Classes/DE/DE.aspx http://tutorial.math.lamar.edu/Classes/DE/DE.aspx
- RivieraKid 8y agoIt doesn't include Green's functions (I don't really know what that is but some other undergrad diff eq books have them).
- sideproject 8y agoDoes anyone know websites or resources which explains how Diff Eq is used in Computer Science? I know it's used in a variety of areas in CS, but I really like to see or read well-explained tutorials or articles. e.g. what's finding area got to do with the topics in CS? what does 'area' correspond to?
- thiagooffm 8y agoAny type of graph you have, you can use it, just like integrals, to calculate areas etc. For a lot of things in life we plot graphs. Your software might do it transparently to you, but how it works internally is using mathematical concepts. It is good to know it and I really enjoyed learning it at college, as it opens your mind about how things work. But I don't believe it is a must to know.
- klrr 8y agoI'm also interested in this, it comes up in a lot of EE courses (DSP, Control theory), but I've yet to see it used in a CS course.
- wnkrshm 8y agoIt's essential in computer graphics or in computational geometry and in simulation science, where I can speak from experience - these are more intersectional topics than pure CS I think but I'd say it's applied CS. E.g. in finding faster ways to do Ray/surface intersections (if we're talking about actually industrially useful geometry like all kinds of splines and not just triangle meshes), differential geometry is essential - even with triangle meshes you can apply it in normal and curvature estimation. Differential equations and integrating them enter the picture if you want to find the shortest way from one surface point to another along the arbitrarily shaped surface. With simulations differential equations are everywhere because any physical system as a function of space (and time) is a collection of differential equations that you need to solve. Earth-movers distance and the Wasserstein metric have recently got attention again, its original relevance was in the Monge-Ampere problem, how to distribute a continuous distribution of 'heaps' of some kind into a distribution of 'sinks' with the least amount of total distance moved. Which is a nonlinear partial differential equation to solve in two dimensions. We need to apply numerical methods, nonlinear optimization to solve such problems and CS is a part of doing that quickly. Because there are no general closed form solutions for most of the systems of differential equations or there we need algorithms to solve them approximately.
- pacotiger 8y agohehehe
- RivieraKid 8y agoCan anyone compare this vs other resources to learn differential equations? I want to learn math roughly to the level of an undergrad engineering student, so I've looked at some Advanced Engineering Mathematics books (one by Zill, another by Kreyszig), both have mostly good reviews, and to be honest, Paul's Notes seem almost a level above in clarity and understandability. For example, compare the explanation of integrating factor and exact equations. The books typically explain exact equations via a total differential, which I'm kind of confused about... why not just say that the left part of the equation is a total derivative? I can't decide whether to continue reading the Advanced Engineering Mathematics book or learn the topics it contains via Paul's Notes and other resources. My worry is that the reason Paul's Notes seem clearer is simply because they're more superficial. What are some other good learning resources for advanced engineering undergrad math?
- enriquto 8y ago> compare the explanation of integrating factor and exact equations those are fringe subjects, completely irrelevant for the modern usage of differential equations. They are useful only in computer algebra when you want to implement differential galois theory. In practice you want to understand the overall behavior of your system (qualitative theory) or compute particular solutions numerically (using numerical methods, which are more precise than evaluating the expression of the exact solution). You'd do much better with a qualitative book about differential equations (e.g., Arnold), about numerical analysis, or about dynamical systems (e.g. Strogatz).
- tanderson92 8y agoIntegrating factors are important motivations in the design of some numerical algorithms. Some keywords: matrix exponentials, semigroup theory, exponential integrators.
- jstewartmobile 8y agoI think the schools spend far too much time on symbolic differentiation and integration. This limits the exercises to the kinds of toy problem that yield to those methods. Kids get sidetracked on solving anti-differentiation puzzles, while the fundamentals are relegated to those (largely useless) puzzles. After 20 years of engineering--in almost every case--numerical methods have been the only way forward. In hindsight, a year-and-a-half long course to convey the fundamentals seems excessive.
- crispyambulance 8y agoWhile numerical methods are absolutely critical in practice, analytic methods like you learn in what people call calculus and diff-eq are _absolutely_ essential to understanding the physical world. You can't actually _understand_ numerical methods without a fairly deep grounding in analytical methods. The real problem is here is a lack of context. Engineering and most science curriculums take a "short-cut" through mathematical education. They try to teach just enough math to get through the major coursework. As a result you end up with students who feel it's all just one big memorization trick .
- jstewartmobile 8y ago> analytic methods ... are _absolutely_ essential to understanding the physical world How so? My experience has been that the "physical world" is where the symbolic approach completely breaks down. > Engineering and most science curriculums take a "short-cut" through mathematical education. Only people taking more math than scientists and engineers would be mathematicians. A year-and-a-half course to cover the limit, tangent-at-a-point, functions of tangent-at-a-point, area-under-the-curve, and generalizing all of that to higher dimensions doesn't seem like much of a "short-cut" if you ask me.
- crispyambulance 8y ago> "physical world" is where the symbolic approach completely breaks down. It does not "break down" it just becomes intractable in certain cases. One needs to be able to solve problems that have all but the most essential details stripped out in order to develop a sense of how physical law actually works. Many times that is even "good enough" to get to a solution. The best way to do that is through analytic methods, which give not only "an answer" but also tell you important features of the answer. These analytic solutions have "handles" you can use to ask "what-if" questions -- eg zero's in the denominator to indicate poles, behavior of the system as you take certain limits, geometric aspects such as symmetry, patterns in recurrence relations, etc, etc, etc..
- bigasscoffee 8y agoused these sites all of the time during engineering. improper integrals, diff eq, etc. these are the best notes ever if you missed class or a concept.
- icedchai 8y agoDiffEqs... the only college class I ever got a C in!
- scrooched_moose 8y agoOh wow, this site was an absolute godsend in college. I was stuck in a DiffEq class with an abysmal professor and barely hanging on. I found this a few weeks in, stopped bothering with useless lectures, and went from low-60s to high-80s over the rest of the semester.
- daze42 8y agoI took Cal 1 and 2 directly from Dr. Dawkins back in 2010-2011. He was the best teacher I had in college hands down. Totally changed the way I thought about math and I've been in love with it ever since.
- jhallenworld 8y agoFirst and second order diffeqs with constant coefficients are a big deal, you should at least learn that. You can solve them algebraically via Laplace Transforms, the theory is very beautiful.