6 ms·
Half of a Coin: Negative Probabilities [pdf]
- Xcelerate 12y agoAs the article hints toward the end, if you extend probabilities into the domain of complex numbers, you basically get quantum mechanics. Scott Aaronson has a well-written and thorough explanation on the matter: http://www.scottaaronson.com/democritus/lec9.html http://www.scottaaronson.com/democritus/lec9.html
- PeterWhittaker 12y agoI read another article some time ago, cannot think how to locate it, that suggested we might have had QM far earlier if someone had seriously pondered the question of what happens if one extends P to the range [-1,1]. I'm really looking forward to physics about 20 years from now, when a lot of the current work in mathematics and complexity theory and information theory has worked its way through the physics community. Valiant's evolvability and Deutsch's information constructor work and pretty much all of Aaronson's work will illuminate bizarre new paths.
- cperciva 12y agoif you extend probabilities into the domain of complex numbers, you basically get quantum mechanics To me, the most fundamental question of quantum physics is this: Why not quaternions? As a mathematician, the distinguishing characteristic of C is that it is the algebraic closure of R; but I see no physical relevance to that.
- deleted 12y ago[deleted]
- tel 12y agoIs there not a model of QM which uses quaternions probabilities? Is there a place where it breaks down?
- jaekwon 12y agoI remember reading things online where people claim that the natural world (probably including what's known in quantum mechanics) is better explained with quaternions.
- judk 12y agoIt's not broadly true. Quaternions are mainly useful for math on the surface of a sphere.
- deleted 12y ago[deleted]
- lisper 12y agoAaronson actually answers this question directly towards the end of the lecture. The short answer is that quaternions don't work for the same reason that real numbers don't work: the probabilities don't work out right for unitary transformations.
- dnautics 12y agolikely because the probabilities in QM need to be commutative (QM operators are not commutative, but the probabilities themselves are).
- stared 12y agoYou can represent two-state systems (qubits) with quaternions. In general, quantum mechanics is about using complex vectors and unitary operations on them. As it is enough to implement quaternions, they are silently used in quantum mechanics.
- deleted 12y ago[deleted]
- gus_massa 12y ago(You must be careful because this probabilities use the normalization \sum(p_i)=1, but in quantum mechanics you must use \sum(|p_i|^2)=1. I think that it's an important difference, because it leads to interference and other interesting phenomena.) The idea is that all the quantum values are complex, and the measurable things are of the form f.f*=|x|^2, you have a symmetry. If you multiply all the universe by i (where i ~= \sqrt(-1) :) ) nothing changes. In general, you can multiply the universe by any complex z such that |z|=1. The global phase is irrelevant. This is the global U(1) symmetry of the universe. But this symmetry is local. You can choose the phase of each point of the universe independently. The problem is that to compensate the arbitrary picks you have to introduce a new field that compensate for the differences of the local election of the phases. This is just the electromagnetic field. (I'm hiding a technical detail here.) This is the quantum version of the old electromagnetic field of Maxwell. The particles of this field are the photons. I can't find an "easy" information source (for someone with a math degree), but you may start reading: http://en.wikipedia.org/wiki/Quantum_electrodynamics#Mathematics http://en.wikipedia.org/wiki/Quantum_electrodynamics#Mathema... The U(1) group has dimension 1, so you have only one "type" of photons. (This "type" is not related to the usual color of the light.) I think it's possible to extend this to the quaternions group of module 1, but it's a 3 dimensional group, so you would have ¿3? photons "types". If all the new "types" of photons are massless, this should be measurable in the experiments. (If the new "types" of photons are heavy, you need to get a bigger particle accelerator to see them, or a theoretical physicist to prove that this idea is actually impossible.) More technical details: The arbitrary election is called gauge theory, this is a local gauge theory because. The other symmetries of the universe is the SU(3) "color" symmetry that is behind the strong force. It's the color of the quarks inside the nucleus it's not abelian so it's more complicated. The associated particles are the gluons, and there are 8 "types". The other symmetry is the SU(2) that is the cause of the weak force, and the particles are the W+, Z and W-. Actually the SU(2) symmetry is mixed with the U(1) symmetry. So the real U(1) group create the a version of the electromagnetic field that is related to the weak-hypercharge, and the photon and Z particles are a mix of the particles of the two fields. The mathematical idea is nice, because you have a copy of U(1) inside SU(2), so you can mix both U(1) groups and mix the particles. As an introduction, you can read http://en.wikipedia.org/wiki/Electroweak_interaction#Formulation http://en.wikipedia.org/wiki/Electroweak_interaction#Formula... but if you don't want to dive in the technical details you can think that the U(1) group is (almost) the electromagnetism an live more happily.
- jaekwon 12y agoOh yay, I'm working my way through that book so I'll look forward to reading that part.
- lisper 12y agoThat's an excellent piece, but he leaves out an important detail: not only can complex numbers generate negative probabilities, they can also generate negative entropies. This observation can be used to answer the riddle of how unitary transformations can produce quantum randomness. See: http://arxiv.org/abs/quant-ph/9605002 http://arxiv.org/abs/quant-ph/9605002 Or for a more accessible account: http://www.flownet.com/ron/QM.pdf http://www.flownet.com/ron/QM.pdf particularly section 5.
- TeMPOraL 12y agoScott Aaronson seems to go in the same direction as Eliezer Yudkowsky did with his posts about quantum physics [0]. Since all of the books I know follow the "historical" / "QWERTY" path, does anyone know/can recommend a book that goes in details along the Aaronson/Yudkowsky path? [0] - http://lesswrong.com/lw/r5/the_quantum_physics_sequence/ http://lesswrong.com/lw/r5/the_quantum_physics_sequence/
- mturmon 12y agoThanks for this link. Many investigators have been dissatisfied with the strong assumptions that conventional measure theoretic probability requires you to make. The community that I'm most familiar with that is stretching these bounds is the imprecise probability people, http://www.sipta.org/index.php?id=cs http://www.sipta.org/index.php?id=cs They have a conference every other year. The simplest generalization is to interval valued probabilities, but there are several other interesting theories. There are some phenomena, such as a failure of long term averages of some actual physical-world stochastic processes to converge, that seem to indicate that conventional mathematical probability does not predict their behavior correctly. I.e., it is a theorem that long term averages of stationary processes should converge, and these don't.
- dnautics 12y agoThere are some phenomena, such as a failure of long term averages of some actual physical-world stochastic processes to converge That's a general property of levy-stable probability distributions, which occur all over the place, and you don't have to resort to unconventional probability to explain most of these processes.
- mturmon 12y agoNo, this is different. There is a theorem, which you can find in Loeve (and other places too I'm sure), that any stationary stochastic process with finite first moment will have long-term averages that converge. IIRC, you don't even need finite second moments. In any case, it has great generality, and basically all you need is stationarity. Presumably a physical system that has stable components in a stable environment will be stationary. You can build a simple electrical circuit of a certain type and compute its long term averages and they do not, in this case, converge. Not slow convergence, like you would see in a process with long range dependence or heavy tails, but lack of convergence, despite averaging over very long times. I have not done is my experiment myself, but my PhD advisor, who did some of the early work on unconventional axiomatizations of probability, did.
- 12y ago
- jaekwon 12y agoOn page 67, "According to the binomial theorem," ... What follows on the right hand side, I'm not sure where that came from. According wikipedia: (1+x)^n = \sum_{k=0}^n {n \choose k}x^k. If you plug in 1/2 for n, you get a sum from n=0 to n=1/2, not n=0 to n=infinity as in the paper. So, this is confusing :)
- jaekwon 12y agoOn second thought, it looks what the binomial theorem could be extended such that k (in the paper this is n) goes to infinity, though for values of k greater than n the value is zero. I'm more intuitive than mathematical. The thing feels like taking a taylor series of a square wave.
- arjie 12y agoHe meant the Binomial series (i.e. the Taylor series about the origin of (1+x)^n. https://en.wikipedia.org/wiki/Binomial_series https://en.wikipedia.org/wiki/Binomial_series
- grondilu 12y ago« Every other number is negative » I don't understand this part. Other than what? Is there a translation error or something? PS. Ok, got it. http://dictionary.reference.com/browse/every%20other http://dictionary.reference.com/browse/every%20other "Every other" is an english idiom to indicate alternation. I did not know it.
- jaekwon 12y agoNo error, it means every other coefficient in the p.g.f. is negative, which is like saying that certain outcomes have negative probability. In the p.g.f. for the double coin example, the coefficient of the monomial for z^0 is 1/4, meaning that the probability of two coins flipping to both tails is 1/4. If the coefficient were negative there, it doesn't make sense intuitively but that's the "magic" when it comes to these magical half coins.
- grondilu 12y agoI'm sorry I was not clear. It's not the negative part I don't get, it's the "every other number". Other than what? I'm not an english native speaker so it might be a math-related english expression I don't know. Is it?
- mhlakhani 12y ago"every other number" == "every second number", i.e. the first, third, fifth ... coefficients are positive, while the second, fourth, sixth .. coefficients are negative. Hope this helps.
- jaekwon 12y ago"every other X" usually means, every even or every odd X, like: ... 0 1 0 2 0 3 0 4 0 5 ... Every other number is 0 above.
- loup-vaillant 12y agoI'm not sure you should be allowed to call "probability" a number that can fall outside the [0,1] range (Or even the ]0,1[ range). Without even reading the paper, I'm pretty sure it doesn't talk about probabilities, but about some related notion.
- stared 12y agoIf you read it, yes, it is a generalization.
- jjgreen 12y agoInteresting example of a pdf which is borked in the Firefox built-in reader, the summations ("Sigmas") are vertically stretched, this not seen in Evince for example.
- quarterwave 12y agoThe probabilities discussed in this paper seem to have an L1 flavour (Manhattan distance) while those in quantum mechanics come from L2 functions (Pythagorean distance).
- wirrbel 12y agoThe author mentions two interpretations of probability, the frequentist and the bayesian one. With both interpretations, a negative probability does not make sense. The frequentist thinks of the ratio number of occurences in the limit of an infinite number of experiments. Negative probabilities would imply negative numbers of occurences (which does not really make sense). In the bayesian interpretation, probabilities are somewhat of a generalization of boolean logic. Based on the assumption that there is True (1) and a False (0), probabilities represent the degree of reasonable believe that a proposition is true. I.e. probabilities are bound in (0, 1). While in math it often turns out that one should not dismiss a certain extension of a calculus (complex numbers are the textbook example, they are not immediately recognizable as "natural" but they work flawlessly and give interesting insights), I really do not get the point here, why would we need negative probabilities? What could we gain from using them? The example brings up an example from the theory of interest, it seems that he identifies an expectancy value-like equation with negative probabilities. I wonder if this could be interpreted as a quasi-discrete case of probability-densities, which can be indeed negative.
- wirrbel 12y agoreally the link posted by another commenter here http://www.scottaaronson.com/democritus/lec9.html http://www.scottaaronson.com/democritus/lec9.html is worth a read