11 ms·
Statistician Proves Gaussian Correlation Inequality
- digital55 10y agoA simple proof of the Gaussian correlation conjecture extended to multivariate gamma distributions by Thomas Royen: https://arxiv.org/pdf/1408.1028.pdf https://arxiv.org/pdf/1408.1028.pdf
- andreasvc 10y agoMathematics has this funny habit of throwing around "it is easy to say that ...", or in this case, calling a proof that eluded mathematicians for decades "simple."
- philipov 10y agoSimple (easy to say) is not the same as being easy to deduce. A needle is a simple object, but finding one in a pile of hay takes a lot of work. Likewise, it is hard to pick out the features that make a problem simple when they are embedded in a sea of complexity. It becomes easy to say once you are no longer faced with the difficulty of knowing the right thing to say.
- cr0sh 10y ago> A needle is a simple object, but finding one in a pile of hay takes a lot of work. 1. Gather all the hay in multiple trash bags (this assumes that the needle remains with the hay and doesn't fall out) 2. After gather the hay, use a roller-magnet pickup tool over the area the hay was at to find the needle if it fell out of the hay (assumes needle is made of ferrous magnetic material) 3. Place each bag, one by one, inside the torus of a CT scanner. Turn on CT scanner. 4. Remove bag of hay. Check inside of CT scanner torus for needle. 5. Repeat as needed with other bags. Alternatively, one could set the hay pile on fire, then run over the ashes with the magnetic pickup tool.
- mehaveaccount 10y ago>Simple to say is not simple to deduce. Case in point: Fermat's Last Theorem, or Collatz Conjecture
- Chinjut 10y agoWell, no, the point isn't that simple propositions may have complex proofs, the point is that a proof may itself be simple, though hard to discover in the first place.
- cperciva 10y agoYou just need to understand the language. "Trivial" = "regularly covered in undergraduate courses" "Easy" = "a good topic for an undergraduate honour's thesis" "Non-trivial" = "a good PhD thesis topic" "Distinctly non-trivial" = "a groundbreaking result which will establish a professor's reputation in the field"
- tnecniv 10y agoI had a professor who liked to talk about how "elementary" did not mean easy, it just means "uses only the foundations." This proof is a perfect example of that statement. Formulating the problem the right way -- which is most often the hardest part -- was the real challenge here, not the mechanisms needed to do the formulation or the proof.
- huhtenberg 10y agoNot sure why, but this reminds me how we had a professor that would say Let y(x) = a*x^4 + b*x^3 + c*x^2 + d*x + e, whereby e is not _necessarily_ the base of natural logarithm
- cperciva 10y agoMy favourite along those lines was "let epsilon be a small number which is not necessarily greater than zero". Everybody who spent the preceding year on epsilon-delta proofs did a double-take at that.
- FabHK 10y agoThere's a wonderful book, by the way, Proofs from THE BOOK, of, well, simple beautiful proofs. The book is named after > mathematician Paul Erdős, who often referred to "The Book" in which God keeps the most elegant proof of each mathematical theorem. During a lecture in 1985, Erdős said, "You don't have to believe in God, but you should believe in The Book." https://en.wikipedia.org/wiki/Proofs_from_THE_BOOK https://en.wikipedia.org/wiki/Proofs_from_THE_BOOK
- sacheendra 10y ago
- deleted 10y ago[deleted]
- mygo 10y agoEasy to prove =/= Easy to discover (+). It is simple to say E=MC^2. That doesn't take away from the fact that it was very hard for it to be discovered. And it's a good thing. It's a good thing that things which were hard to discover can be communicated easily. Otherwise we wouldn't be able to compress thousands of lifetimes worth of discoveries into a one-semester lecture. --- (+) footnote: well, unless P=NP.
- Sniffnoy 10y agoAbstract link: https://arxiv.org/abs/1408.1028 https://arxiv.org/abs/1408.1028
- meow_mix 10y agoI love stories like this one. Reminds me of the the twin prime story from a little while ago. Well written article as well!
- JadeNB 10y agoAs someone who has been funded by them, I think that I am nonetheless not being biased when I say that the Simons Foundation does a huge amount of good for the sciences, not least by funding this kind of consistently quality science journalism.
- ISL 10y agoI'm not funded by them, and I generally think the Simons Foundation does great work.
- bglazer 10y ago> Not knowing LaTeX, the word processer of choice in mathematics, he typed up his calculations in Microsoft Word ... > He opted instead for quick publication in the Far East Journal of Theoretical Statistics, a periodical based in Allahabad, India, that was largely unknown to experts and which, on its website, rather suspiciously listed Royen as an editor. I couldn't help but laugh at this part. He proved a classic theorem in statistics and then precision engineered the actual submission to be roundly ignored. Makes me wonder if there's a proof of P=NP with ClipArt illustrations that's buried in the South Asian Journal of Mathematics.
- shas3 10y agoWhile it's hard to believe, there are entire fields where top journals can take 2 years to publish (no early publications, no culture of preprints, etc.) For example, in one subfield of EE where I once worked in mid oughts, the choice ws between an IEEE journal that took 2.5-4 yrs to publish or lesser known IET and online journals that published faster. Such fields are few in 2017. But it's not implausible that in 2014 the only two quick forums in statistics he was aware of were Arxiv and lesser known journals.
- sdenton4 10y agoThe great thing about the arxiv, though, is that you can submit the preprint early while the paper goes through review at a 'real' journal. Review takes time... Unless you submit to your own journal... I'm surprised good friend didn't help with a better choice of journal, even a non top tier one.
- Xcelerate 10y agoThere's entire trails of papers that cite each other on arXiv while they wait for a 1-2 year review for journal publication. It's crazy — the journal has in some regards become a formality necessary for career advancement, while the actual research in a field progresses in the form of postings on a preprint server.
- a_bonobo 10y ago
- mrcactu5 10y agoterry tao has a great discussion of the entropy power inequality http://mathoverflow.net/questions/167951/entropy-proof-of-brunn-minkowski-inequality http://mathoverflow.net/questions/167951/entropy-proof-of-br...
- d--b 10y agoThe proof is hard to read for non-statistician. Is anyone willing to give a short human-readable summary of how it works? Also, the conjecture seems fairly simple, so it'd be great to understand what made it hard to prove.
- onuralp 10y agoHere is a blog post that I think clarifies why this conjecture had remained unsolved: https://almostsure.wordpress.com/2009/09/27/the-gaussian-correlation-conjecture/ https://almostsure.wordpress.com/2009/09/27/the-gaussian-cor... There is also a 'companion' article on arxiv that provides a clear presentation of Royen's proof: https://arxiv.org/abs/1512.08776 https://arxiv.org/abs/1512.08776
- darawk 10y ago> Imagine two convex polygons, such as a rectangle and a circle Hrm....
- georgecmu 10y agoYou can think of a circle as an infinity-gon.
- thaumasiotes 10y agoI like "infini-gon" :D
- nicklaf 10y agoTerminology pedantry: a disk (not a circle, which is far from being even convex, being just the boundary of a disk) is indeed not a (convex) polytope, although it is a convex body.
- 0xdeadbeefbabe 10y ago> “It is like a kind of grace,” he said. “We can work for a long time on a problem and suddenly an angel — [which] stands here poetically for the mysteries of our neurons — brings a good idea.” Had he learned LaTeX, I wonder if it would be a matter of justice.
- openasocket 10y agoI seriously can't believe that a problem that has evaded mathematicians for decades could turn out to have a 9 page elementary proof! I don't know whether to be excited that, maybe, other hard problems in mathematics could have such elementary proofs, or depressed that mathematicians took so long to solve a problem with such a simple answer :)
- noobermin 10y agoOr it was ignored because it didn't have an author from Harvard or Princeton on it.
- noobermin 10y agoHere's another data point in one of HN's favorite topics, how academia and publishing are broken.
- JorgeGT 10y agoFrom reading the article, it seems that his proof is straight from The Book.
- a3_nm 10y agoCalling this a "famous long-standing mathematical conjecture" seems a bit of a stretch. It gives the impression that this would be comparable to Fermat's Last Theorem, the ABC conjecture, the Riemann hypothesis, etc. However, this conjecture doesn't seem to have a Wikipedia page. The discoverer, Thomas Royen, does not have a Wikipedia page either. The Loren Pitt paper establishing a special case of the conjecture was cited only 50 times. The only justification for the importance of the problem that I see in the original article is that it was open since 1972 and someone is quoted as having worked 30 years on it and knowing other people who have worked long on it. That's something, of course, but it's not so much -- there are lots of problems in mathematics that remain unsolved after some decades despite serious efforts, and not all of them are famous ; it depends on how much attention they have attracted.
- infogulch 10y agoCiting the Wikipedia articles' existence is a curious argument to make when an article titled "40% of Wikipedia is under threat from deletionists" [1] was just on the front page. [1]: http://boingboing.net/2017/02/16/40-of-wikipedia-is-under-thre.html http://boingboing.net/2017/02/16/40-of-wikipedia-is-under-th...
- FrozenVoid 10y agoObviously obscure content will not survive unless it somehow gains fans willing to guard the page from these people, who pretend wikipedia is paper encyclopedia with limited budget for "notable" topics. They have to defend citations, perceived bias/neutrality and fight merge/deletion votes, gain allies with admins once it reaches arbitration and explain the article "notability" each time its questioned(and articles can lose "notability status" once one of these pedantic autists start questioning every line and word, deleting everything not following exact rules). In fact an isolated article, with new content or very few backlinks will not even be accepted and get speedily deleted before it gets worked into something acceptable to wikipedians. There has to be an alternative to this.
- a3_nm 10y agoDespite deletionists' efforts, I doubt that any long-standing mathematical conjecture which can reasonably be called "famous" (to a general, non-specialist audience) does not currently have a Wikipedia page. My point about the article is just that I found it annoying to be made to believe that this was about a very major result and find out later that the claims of fame had been exaggerated.
- huahaiy 10y agoThis conjecture seems to be easily seen as true by intuition. It's surprising that it took so long to find a proof.
- vecter 10y agoCan you explain to me how this conjecture is intuitively true?
- andreareina 10y agoLet's say A has a 0.7 probability, and B has 0.6, and are independent. The compound probabilities are gotten by multiplying the individual ones: Neither: 0.3 * 0.4 = .12 A, not B: 0.7 * 0.4 = 0.28 B, not A: 0.3 * 0.6 = 0.18 Both: 0.7 * 0.6 = 0.42 Now let's say that they're not independent; in fact, B absolutely requires A. You'd get something like: Neither: 0.3 (this is reduced to the chance of not A) B, not A: 0 (B can't happen without A) Both: 0.6 (only other probability with B, has to make up the 0.6) A, not B: 0.1 (simply what's left to sum to 1.0) Concrete examples of independent events: (fair) coin tosses -- the chance to come up heads is always the same, no matter the prior result. Related events: being dealt a face card in blackjack, and winning the hand -- whatever your normal chance of winning a hand, the odds of winning that particular hand just went up.
- deleted 10y ago[deleted]
- The_suffocated 10y agoThe paper has only seven pages, but the actual proof is even shorter --- it spans from p.3 to p.5. So, it's a three-page proof. Really well done.
- JCzynski 10y agoCould anyone explain why it is impossible for a Gaussian distribution to be anti-correlated with a group of N other Gaussians? This proof clearly implies that fact, but none of the discussion seems to remark on it. I can imagine a distribution such that the "random seed" puts things closer to the tails based on the measured variance of a group of other normal distributions. Intuitively it seems like that ought to be able to be a normal distribution itself; I don't follow why that is not true.