15 ms·
Why is Maxwell's theory so hard to understand? (2007) [pdf]
- k9s9 8y agoInteresting. And makes me wonder what else we are missing and misunderstanding, as we waste so much time trying to express the complexity of the world in spoken language rather than math. Not just physics but in sociology, psychology, economics etc. Faraday purely from experiments 30-40 years before Maxwell, intuitively understood electromagnetism. Nobody serious believed it because he didn't have the training to express it mathematically. Dyson is saying it took Physicists another 20-30 years post Maxwell to get it. So basically ~70 years wasted.
- naringas 8y ago> So basically ~70 years wasted. to call those years wasted implies that we shouldn't have had to wait for them. it suggests that we should look for a way to bypass them.
- madengr 8y agoMaxwell unified electromagnetism into a propagating wave. That was the big leap. Before that, things were disparate. Hertz proved it experimentally, and Heaviside turned it into an engineering discipline.
- tntn 8y agoThis is true of the mathematics, but it's worth noting that Faraday had already proposed EM waves ~30 years earlier based on his intuitive understanding.
- jbay808 8y agoAnd had rejected the aether, on the basis that it was unimaginable that any medium could propagate transverse waves in all directions but not allow longitudinal waves.
- Retric 8y agoWasted implies the solution is somehow obvious but that’s hindsite bias. Looking at lotto winners it feels easy. But, the reality is a lot of effort went to things both promising and wacky to get those steps forward. And other less major progress is being glossed over.
- tim333 8y agoSpoken language has a lot going for it. I note the featured article and it's discussion are all words not maths. By the way looking at Maxwell's paper it seems awful complicated https://royalsocietypublishing.org/doi/pdf/10.1098/rstl.1865.0008 https://royalsocietypublishing.org/doi/pdf/10.1098/rstl.1865... compared to the modern form of the equations https://ethw.org/w/images/d/d6/Maxwell_image_02.jpg https://ethw.org/w/images/d/d6/Maxwell_image_02.jpg
- ncmncm 8y agoThe modern form of the equations was worked out by commoners, so had to be filtered through the work of others before it could be taught.
- scabarott 8y agoYou're really caught up on this commoner/non-commoner dynamic (from your other comments). Was it really that important? - many of the well known scientists of that time were 'commoners'.
- ncmncm 8y agoI'm not, but they were. But it was not discussed openly in print at the time, and so must be inferred.
- tim333 8y agoI just read his Wikipedia and he was sponsored by his uncle Sir Charles Wheatstone of Wheatstone bridge fame and ended up a Fellow of the Royal Society so was not so badly situated.
- Gibbon1 8y agoHeaviside thought that too which is why he invented the modern form. Not that he just used a different set of math to describe the problem, he invented the math too.
- 8y ago
- ncmncm 8y ago[retracted]
- tntn 8y agoLord? Faraday was no lord. He was also dead by the time Maxwell gave this presentation.
- grigjd3 8y agoIn truth, it generally takes significant time to arrive at fundamental theories. Most people don't realize this because in a physics class, at best, you might get taught when so-and-so published an equation.
- pm90 8y ago> Pupin went first to Cambridge and enrolled as a student, hoping to learn the theory from Maxwell himself. He did not know that Maxwe ll had died four years earlier. After learning that Maxwell was dead, he stayed on in Cambridge and was assigned to a college tutor. It wasn't that people spend all those years actually working on this problem. There wasn't an internet nor modern travel to share/disseminate/argue about these ideas.
- naringas 8y ago>We still have passionate arguments between believers in various interpretations of quantum mechanics, the Copenhagen interpretation, the many-worlds interpretation, the decoherence interpretation, the hidden-variables interpretation, and many others. lukcily there has been slight progress since 2007 https://www.quantamagazine.org/frauchiger-renner-paradox-clarifies-where-our-views-of-reality-go-wrong-20181203/ https://www.quantamagazine.org/frauchiger-renner-paradox-cla...
- almaya 8y agoIt seems that this arguably new paradox has some issues: https://www.scottaaronson.com/blog/?p=3975 https://www.scottaaronson.com/blog/?p=3975
- gumby 8y agoI am struck by the clarity and simplicity of Dyson's writing. As to the substance: yes, hiding your work under a bushel does nobody any favor, but it's understandable when it feels like the alternative is the strident trumpeting of trivial "advancements". But also cautionary is the constraints due to the wrong metaphors. We often see this today in linear predictions as to the impact of some new idea. It's easy to mock Ballmer when he laughed at the iphone back in 2007 (back when this essay was written). But his comment made sense for his customer base. He (and nor could Apple) couldn't really see that the game was changing. Dyson points out that Maxwell himself had the same problem.
- hopler 8y agoWhy would you say Apple, whose main business was an extensive traxk record in creating, promoting, and selling next generation technology, that their major investment in a new field was blind speculation? In contrast to Microsoft whose business was providing stable solutions and extracting monopoly rents.
- aj7 8y agoThis is (1) False, or a venomous mid-80s position. (2) Irrelevant to the theory of electromagnetism.
- gumby 8y agoNot sure I understand your point. Mine was that in science or business we are often held back from understanding by the limitations of our models, even when we ourselves are the inventors. I thought I used an example well known to HN to make the point. Apple’s stated hope was to eventually have 1% of the market (and they didn’t originally plan for an App Store). Like Maxwell, they didn’t know they had a blockbuster. Microsoft listened very closely to their customers, who were and are mainly corporate I/T and something like the iphone wasn’t something they said they wanted. In fact it honestly had no affordances that IT wanted. Maxwell understood the math but his own mechanical metaphor distracted him, and other physicists too, so that they couldn’t really see the larger implications.
- paulpauper 8y agoMaxwell did not use vector calculus, which actually makes it pisser to understand because it bypasses having to convert the vectors to coordinates. I find short hand notion more confusing than writing it all out even if the latter takes more room. I did not understand general relativity at all until I saw an example where everything was written out and then it made much more sense
- earthicus 8y agoThis is something of a myth. Maxwell actually uses both to ease the mathematical pain for his readers - he writes the equations out coordinate by coordinate, and he also compresses them using Hamilton's (quaternion) model of vectors. In fact Maxwell was the one who introduced the gradient, curl, and divergence (actually he used convergence) operators, and he addressed precisely your concern in his book by giving both formulations!
- tntn 8y agoQuaternions are not a "model of vectors." Maxwell used per coordinate equations and quaternion equations, but never wrote out what are now known as "Maxwell's equations," which were first formulated by heaviside using Gibbs-Heaviside vector calculus. Gibbs-Heaviside vector calculus formulations proved far more valuable to engineers and scientists than the equivalent quaternion formulations - despite the criticisms from Hamilton and Tait.
- earthicus 8y agoMaxwell explicitly uses the imaginary part of a quaternion as a model of vectors, just as Hamilton did: > A german letter denotes a Hamilton vector, and indicates not only its magnitude but its direction. The constituents of a vector are denoted with roman or Greek letters. [1] Gibbs and Heaviside or course use a different algebraic model of vectors, which is the one used in introductory courses now. But the more significant change made to get to "maxwells equations" as we know them now is not a slight change in the mathematical formalism. The big difference is a change in the underlying physical model: Maxwell's original treatment is largely in terms of potentials, which Heaviside modified to focus on the E-M force fields directly. This change is what gives the familiar four equations we know today, not fiddling with your parameterization of the rotation group, or similar games. Nowadays physicists frequently use a tensor or forms model of vectors in addition to the gibbs model. [1] https://archive.org/details/ATreatiseOnElectricityMagnetism-Volume2/page/n279 https://archive.org/details/ATreatiseOnElectricityMagnetism-...
- wmnwmn 8y agoE&M is far from "simple". It contains special relativity, for starters. Also it is incompatible with thermodynamics: solving this problem is why Planck invented quantum mechanics. Also point charges have infinite energy: this problem leads to renormalization theory. Also it introduces gauge invariance, an essential but complex part of all modern theories. And lastly, the mathematics of E&M is a big step up from Newtonian theory.
- nonbel 8y ago>"E&M is far from "simple". It contains special relativity, for starters." A theory (which is just a set of assumed first principles and rules of logic) can be simple but allow you to deduce vast complexity from it. In fact, it is ideal for a theory to be as simple as possible. The "game of life" is not really a theory, but it demonstrates that simple rules can lead to surprising complexity: https://en.wikipedia.org/wiki/Conway%27s_Game_of_Life https://en.wikipedia.org/wiki/Conway%27s_Game_of_Life EDIT: I can't begin to imagine why this would trigger a downvote. Are there people out there who prefer complex theories that make things more difficult to understand than necessary? Perhaps because it makes them feel smart or something, I don't know. But that is basically saying you dislike science, because the point of science is to synthesize information into a small set of simple "laws" that allow us to deduce accurate and precise predictions.
- aj7 8y agoI reflexively downvote the game of life. I have never heard of a single useful application or analogy of “finite automata.” Yes, there are speculations about extremely small Planck lengths, by no new physics has panned out. Finally I am sad that one of the greatest computer scientists and polymaths, Ed Fredkin, got sucked into this. We all have weaknesses.
- ckocagil 8y agoSurely you mean cellular automata, not finite automata.
- bsder 8y agoPeople didn't really get Maxwell because Maxwell's equations don't need a medium aka "aether". Waves propagating without a medium is a shocking message in this time frame. Maxwell published his equations in 1861/1862 in first form. In 1887, the Michelson–Morley experiment gave the first experimental disproof of the "aether". It also doesn't help that you have things like "displacement current" and have to find strange integration surfaces to make Maxwell's equations work out for things like capacitors or motors. (The Heaviside-Hertz pedagogy that everybody is STILL taught is particularly problematic to use for motors.)
- NotAnEconomist 8y ago> In 1887, the Michelson–Morley experiment gave the first experimental disproof of the "aether". In what way is LIGO not a bigger, and successful, version of the Michelson-Morley experiment? I'm honestly asking, because from my limited understanding, it seems to be. From Wiki: > This result is generally considered to be the first strong evidence against the then-prevalent aether theory, and initiated a line of research that eventually led to special relativity, which rules out a stationary aether. It seems that LIGO merely confirmed properties of an existent aether, not that we no longer believe in one: > Aether theories (also known as ether theories) in physics propose the existence of a medium, the aether (also spelled ether, from the Greek word (αἰθήρ), meaning "upper air" or "pure, fresh air"[1]), a space-filling substance or field, thought to be necessary as a transmission medium for the propagation of electromagnetic or gravitational forces. Naively, spacetime and quantum fields are both forms of aether theories.
- whatshisface 8y agoThere might be some philosophical or creative writing overlap in the way the two are described, but the actual things that the theories are saying are completely different, lacking even a conceptual similarity.
- bsder 8y agoIf LIGO confirmed "aether", then the measurements in the perpendicular arms would vary depending upon time (orientation of Earth in rotation, orientation of Earth around Sun, etc.). As far as I know, they very much do NOT vary--to an absolutely amazing precision. As far as I can tell, if the "aether" existed and we could detect it, we basically would have no hope of detecting gravitational waves. > Naively, spacetime and quantum fields are both forms of aether theories. Not ... really. The existence of "aether" implies a preferential frame of reference. And every experiment we have done to attempt to establish such has failed.
- ncmncm 8y agoIt is unfortunate that Dyson neglects the role of Oliver Heaviside, again. This is in a long tradition of English neglect, ultimately traceable to Heaviside's status as a commoner. Heaviside invented the mathematical tools we still use to understand and teach Maxwell, and most of the important consequences of the theory, but Pupin, Hertz, Marconi, and deForest used his methods and <del>took</del> got the credit. Today Heaviside's method is taught as Laplace transforms, with Heaviside's name scrubbed off. We only hear of him as an alternative name for the step function, the integral of the Dirac impulse function, and of the "Heaviside layer", the ionosphere that makes transcontinental radio actually possible, but we would have waited decades longer without him. An excellent reference for the importance of Heaviside in the ultimate success of application if Maxwell's theory is Paul J. Nahin, "Oliver Heaviside: The Life, Work, and Times of an Electrical Genius of the Victorian Age", https://www.amazon.com/Oliver-Heaviside-Electrical-Genius-Victorian/dp/0801869099/ref=mp_s_a_1_1?ie=UTF8&qid=1546801611&sr=8-1&pi=AC_SX236_SY340_QL65&keywords=nahin+heaviside https://www.amazon.com/Oliver-Heaviside-Electrical-Genius-Vi...
- tntn 8y agoI'll second that book recommendation. It's incredible that you can ask a graduating class of EEs if they know of heaviside and only get some mumbling about a step function, given that Heaviside developed the majority of the fundamental ideas still used in EE. Complex impedance, vector calculus, Maxwell's equations, telegrapher's equations, precursors of s-domain methods, inductive loading, many of the names for AC circuit concepts. I think Hertz acknowledged Heaviside's contributions, though, and didn't intentionally take credit for his work. I could be confused, though.
- ncmncm 8y agoIt was deForest, particularly, who pretended to originality. I should have written "got".
- iorrus 8y agoExactly, one of the main reasons why maxwell is so hard to understand is that everything is expressed using quarternions unlike Heaviside who expressed the equations using the vector notation we see them expressed in today. In reality ‘Maxwell’s’ equations are in fact Heaviside’s.
- amelius 8y agoSome people hold the view that a better way of teaching electromagnetism is through geometric algebra. See: https://arxiv.org/abs/1010.4947 https://arxiv.org/abs/1010.4947
- Koshkin 8y agoAlso, the approach based on differential forms is very appealing; for a list of various formulations of electromagnetism, see https://en.m.wikipedia.org/wiki/Mathematical_descriptions_of_the_electromagnetic_field https://en.m.wikipedia.org/wiki/Mathematical_descriptions_of...
- earthicus 8y agoThe differential forms approach also has the advantage over geometric algebra of being widely used by mathematicians and theoretical physicists, and perhaps increasingly used by physicists in general. If you're going to put in the effort to learn geometric algebra, learning differential forms instead would be much much more useful in opening up the literature to you. A 'lightweight' intro is [1]. [1] https://www.amazon.com/Electricity-Magnetism-Mathematicians-Thomas-Garrity-dp-1107435161/dp/1107435161/ref=mt_paperback?_encoding=UTF8&me=&qid= https://www.amazon.com/Electricity-Magnetism-Mathematicians-...
- 19f191ty 8y agoAren't the two very closely related, if not equivalent? Differential forms and Geometric Algebra I mean.
- jules 8y agoYes, they operate on the same objects. The main operations on differential forms are the exterior derivative d and the wedge product f /\ g. These are independent of the metric. If you add a metric you get one extra operation called the Hodge star ⋆, which is a prefix operator, so it operates as ⋆f. Alternatively, if you have a metric on your space you can define the geometric algebra derivative D and the geometric product. These are closely related to the differential forms operations, e.g. Df = df + ⋆d⋆f. Using it, Maxwell's equations become one equation, namely DF = J where F is the electromagnetic field tensor and J is the four current. So in my opinion it's indeed best to not put this as differential forms vs geometric algebra, but rather as a single theory in which some operations don't depend on the metric (d, /\) and some do (⋆, D, geometric product). Unfortunately, geometric algebra has been overhyped by its proponents, and the papers they write are less than rigorous, so some people are under the impression that it's crackpottery, so it's safer to call it Clifford algebra :)
- deleted 8y ago[deleted]
- aj7 8y agoSay what? Start with the integral representations of the equations a la Halliday and Resnick. You can do tons of useful problems. Once you understand vector calculus, you will understand the equations as written in differential form. Then, pick up a copy of Purcell to see how magnetism comes out of the Lorentz transformation of electrostatics. If you are mainly interested in applied problems, go through Corson and Lorraine. Finally: 1. Realize that the treatment of ferromagnetism is much too limited in most E&M texts. 2. Optics is also worthless in those books. It is a field unto itself, with theoretical, applied, and quantum parts all handled by different books. 3. You don’t use Feynman’s Lectures to learn anything the first time. You use them to see if you understand physics as well as Feynman (you don’t.). All the problems have to have been done BEFORE this step.
- deleted 8y ago[deleted]
- killjoywashere 8y agoIt's not until now, over 20 years later, that I realize what a magician my E&M prof was. After months of careful development of basic E&M, Maxwell's equations simply fell out. As I recall, it was capacitance that was the impetus. It was as though we had struggled in a dark tunnel for months and suddenly came around a turn and there was light. Not a little, but sheets of daylight and all the equations just fell together, one from the next. All the equations revealed themselves from the middle of one lecture to the middle of the next lecture. And then, in E&M 2, with a different professor, I spent the entire semester coming to grips with the fact that the implications of these formulas would challenge my grasp on reality for the rest of my life.
- amatthew 8y agoIn what ways were they that important later in life?
- killjoywashere 8y agoBecause my undergrad is in physics and I'm still in science, E&M opportunities are evident to me, but I know I would struggle to really go after them myself. So I get help, but I sure wish I could do it on my own.
- mikorym 8y agoI have a copy of Maxwell's two volumes on electromagnetism and what makes it difficult to read for me is that his "equations" are actually a long list of disparate equations that describe a unified theory. It's not a simple "answer" such as E=mc^2, it is a series of such descriptor answers. Mathematically, it is easier for me to focus on one aspect and study that aspect's equations (at a time).
- UncleSlacky 8y ago"The phrase “Another theory of electricity which I prefer” seems deliberately intended to obscure the fact that this was his own theory." To me, this just sounds like typical British understatement, which I'm sure the audience at the time would have understood.
- weedwarrior 8y agoThe theory is very easy to understand. Its the differential notation and manipulation of said notation that is challenging for people who dont math often