12 ms·
Doubts over a ‘possible sign of life’ on Venus
- piptastic 6y agoI thought this article did a good job of explaining the potential problems with the original findings.
- scarmig 6y ago> Greaves and colleagues used a twelfth-order polynomial, or an equation with twelve terms (plus a constant, the +b in the equation), to describe the noise in their ALMA data. Hah. Wish that had been more emphasized in the original popular reports.
- sfvisser 6y agoReminds me of Von Neumann's "With four parameters I can fit an elephant, and with five I can make him wiggle his trunk."
- scarmig 6y agoI was playing with a formulation like "with twelve parameters I can change lead into gold," but I like Von Neumann's whimsy a lot more.
- flobosg 6y agoThat was actually implemented in a paper: https://fermatslibrary.com/s/drawing-an-elephant-with-four-complex-parameters https://fermatslibrary.com/s/drawing-an-elephant-with-four-c...
- canjobear 6y agoYou can do it with one parameter http://colala.berkeley.edu/papers/piantadosi2018one.pdf http://colala.berkeley.edu/papers/piantadosi2018one.pdf
- contravariant 6y agoUsing complex parameters, clever.
- TeMPOraL 6y agoIf you try hard enough, you can do anything computable with a single integer parameter - if your model is a Turing machine, and the parameter encodes a program. It's perhaps less clever or cool than the hack above (by virtue of us being used to Turing machines), but serves as a friendly reminder that you can encode a lot of information in a long enough number.
- lisper 6y agoThe real lesson here is that "number of parameters" is not a useful measure of information content. The only useful measure of information content is information entropy, which is the logarithm of the number of distinguishable states. The base of the logarithm is arbitrary, but by modern convention is invariably taken to be 2. The resulting unit is the bit.
- deepnotderp 6y agoThis is not true. Consider the two sequences: 1 2 3 4 5 6 And 6 4 6 3 8 2 Do these sequences really have equivalent entropy? Welcome to algorithmic information theory :)
- lisper 6y agoYour example is vacuous. You cannot determine the information content of a sequence of numbers in isolation. You can only determine information content of a system with respect to a model that tells you how to use the state of the system to distinguish between a number of possible states. The information content of the system is the log of the number of possible states from which the state of the system allows you to select one. Yes, algorithmic information theory is a thing. But neither it nor your example refute what I said (because what I said is in fact true).
- 6y ago
- deleted 6y ago[deleted]
- 1-more 6y agoThere's a perpetual quest in strength sports to create an equation that lets you compare the relative strength levels of athletes in different weight classes. In weightlifting the Sinclair formula uses allometric scaling to try to roughly answer the question "if we scaled this lifter to the size of the overall world record holder, how much would we expect them to lift?" That's a decent approach. However for a long time powerlifting used the Wilks formula which was, you guessed it, a 5th order polynomial. Hilariously, there are discontinuities in the formulas. If a man bulks up to a bodyweight approaching 283.034 kg, his Wilks score approaches infinity. Same for a woman at about 208.391kg. But if that's your strategy then don't overshoot as the limit from the right is negative infinity. Sinclair: https://en.wikipedia.org/wiki/Sinclair_Coefficients https://en.wikipedia.org/wiki/Sinclair_Coefficients Wilks: https://en.wikipedia.org/wiki/Wilks_Coefficient https://en.wikipedia.org/wiki/Wilks_Coefficient discontinuities for men in Wolfram Alpha https://www.wolframalpha.com/input/?i=discontinuities+in+y%3D500%2F%28-216.05%2B16.26x+-0.002388645x%5E2-.00113732x%5E3%2B0.701863*10%5E-5*x%5E4-1.291*10%5E-8*x%5E5%29 https://www.wolframalpha.com/input/?i=discontinuities+in+y%3... discontinuities for women https://www.wolframalpha.com/input/?i=discontinuities+in+y%3D500%2F%28594.317-27.2384x+%2B0.8211x%5E2-.009307x%5E3%2B4.7316*10%5E-5*x%5E4-9.054*10%5E-8*x%5E5%29 https://www.wolframalpha.com/input/?i=discontinuities+in+y%3...
- benibela 6y agoGPT-3: I need 17 billion parameters to create text
- visarga 6y agoOn the other hand how many parameters do we need to create text? A simple calculation of number of parameters in the human brain divided by seconds of lifetime yields: 10^14 synapses / (72.6 * 365 * 24 * 3600 seconds) =~ 43000 synapses/second, not all of them related to language and reasoning. So we use tens of thousands of synapses for each second of our life, which is quite a contrast to the 100 bits of information per second which is estimated for conscious processing.
- beervirus 6y agoYeah that seems pretty questionable. Why would noise follow a polynomial at all, much less a 12th order one?
- blackbear_ 6y agoIt was actually discussed quite openly and in detail in the original paper [1]. [1]: https://www.nature.com/articles/s41550-020-1174-4 https://www.nature.com/articles/s41550-020-1174-4
- imvetri 6y agoWe can't complain about things being wrong. We can't correct things that are wrong. But we can educate others that we are the sign of life and we are the life. Take a breath, and cherish that. At one point, it wouldn't matter if there is life outside our galaxy or life outside our solar system or outside our planet or outside us. Only thing that will matter is there is life within us and our focus will shift there.
- bigbubba 6y agoIs this GPT-3 text? It's incomprehensible.
- 0x22d 6y agoLook at his comment history. It has to be GPT-3 or something of that nature, holy shit
- SubiculumCode 6y agoThis is quickly turning to the new form of insult in enlightened compsci forums.
- marketingPro 6y agoNot sure if HN understands what science is, because I caught reddit saying a scientist's opinion was science. Science is science when an author can be removed from a study and the experiment can be repeated. A 12 year old or science hater should be able to reproduce the results if it's science. Things that aren't science- >Authority- A PhD/medical doctor/a scientist, these are human opinions, not science. They can cite studies to be scientific. >Art >Tradition There's value in non scientific disciplines, but they have their own burdens to be aware of.
- rriepe 6y agoScience has become an ironic religion for people who believe there's such a thing as a non-religious human.
- scarmig 6y agoThere's a segment of the population that sees scientists as materialist, secular replacements for priests and mystics, instead of sophisticated monkeys trying their best to make sense of a messy, confusing world. As a side note, I'd push back against the idea that replicability is the key ingredient of science: it's neither necessary nor sufficient to discover scientifically "true" knowledge, though it's definitely a nice to have. Plenty of important measurements have been made confirming theories we see as true today (or true enough) that turn out to have been irreproducible, plagued by experimenter bias, or even outright fraudulent. But it's a particular research programme, embedded in a social context, that generates knowledge, not a single reproducible experiment.
- fastball 6y agoMaybe that is because there is a segment of "scientists" (read: people who publish in "scientific" journals) that are just materialist, secular replacements for priests and mystics. Can you give an example of something that isn't reproducible but was still true?
- renewiltord 6y agoI imagine the LD50 of many substances are defacto non-reproducible despite being mechanically replicable. i.e. the world will not permit us to test the LD50 of FOOF so any measure of its danger to human lives is defacto untestable. Yet we have a notion of its truth. Of course there is an epistemological distinction here between a thing that cannot be reproduced by its nature vs. one that cannot be reproduced by societal norms.
- awb 6y agoThe original "signs of life discovered on Venus" announcement was discussed a couple months ago here: https://news.ycombinator.com/item?id=24463423 https://news.ycombinator.com/item?id=24463423 Numerous comments about the promoter's non-scientific background, the sensationalism of the original announcement and skepticism over the findings. Please note that the scientists themselves weren't sensationalizing their findings, but others were. As this article points out: it was a "big, if true" story that had numerous red flags from the start.
- canjobear 6y agoInterestingly in the old comment thread, and the other ones I read at the time, there was lots of discussion about how the phosphine might have originated non-biologically, but no one suggesting a problem in the data analysis. Now it looks like that is what happened. It also means just about no one read the real paper...a twelfth-order polynomial would certainly be a red flag for me. Interesting moral here for interpreting science: surprising results don't usually have interesting explanations. It's usually a bug.
- garmaine 6y agoLots of people said that the data analysis might fall apart upon looking closely, as has happened many times before.
- gus_massa 6y agoThe 12 degree polynomial is red flag as big as the Soviet Union. No one made a comment about that. I made a comment in that thread, but I didn't notice the 12 degree polynomial. Perhaps I'm too optimistic, but I expect someone to read the paper and make a comment about that in HN.
- Zeratoss 6y agocan you explain for someone not super math savy?
- raxxorrax 6y ago> One strategy is to write an equation that describes the wiggles Don't telescopes have some lens coatings that could dampen certain wavelengths? Or some form of giant sun glasses? I don't understand how you would approach removing noise basically. A 12th order polynomical can fit many, many curves with really good detail already. But what signal were they trying to interpolate?
- flobosg 6y agoThe controversial claims made a decade ago about the discovery of arsenic-based life come to mind: https://en.wikipedia.org/wiki/GFAJ-1 https://en.wikipedia.org/wiki/GFAJ-1
- bigbubba 6y agoI recently met somebody who read and believed the initial headlines for that story but never heard any updates. I think science reporting has some serious problems and no clear way to hold anybody accountable for it.
- goatlover 6y agoMedia reporting in general has that problem.
- Conlectus 6y agoAs a data point, I was (until just now) one of those people.
- nitwit005 6y agoIf there was a news site that purely had follow up to old stories, I'd subscribe. The media only provides it for things like trials that people continue paying attention to. One reason people stall investigations is they know the press will forget after a few months.
- jobigoud 6y agoI was going to suggest "oops.science" as a domain name but it's already parked...
- BlueTemplar 6y agoHuh, so did I...
- flobosg 6y agoIn my case I knew of the aftermath because I work on the field and followed the reports of science writers such as Ed Yong and Carl Zimmer as well as the blog of Rosie Redfield, one of the microbiologists that took part in the testing and posterior refutation of the published results.
- dekhn 6y agoNASA had already reduced its credibility in the biological community when it promoted this: https://www.nasa.gov/topics/universe/features/astrobiology_toxic_chemical.html https://www.nasa.gov/topics/universe/features/astrobiology_t... which turned out to be so completely wrong it's ridiculous: https://www.nature.com/news/arsenic-life-bacterium-prefers-phosphorus-after-all-1.11520 https://www.nature.com/news/arsenic-life-bacterium-prefers-p... Coupled with NASA's constant touting of crappy life science aboard ISS, I've more or less just tuned them out (with a prior probability of 0.01).
- gadders 6y agoThere was also that other time they maybe found life on Mars: https://www.youtube.com/watch?v=pHhZQWAtWyQ https://www.youtube.com/watch?v=pHhZQWAtWyQ in 1996
- garmaine 6y agoThat’s actually not a good example, because the follow up analysis actually confirms the initial result. ALH84001 is actually some pretty good evidence for fossilized Martian life. What happened though was that they went public early with too little information, because they were worried about being scooped in the media. When they got asked questions that they didn’t have answers to, the result started to look like it was on shaky grounds. The opinion was formed that it was a bad result. After that it was pretty hard to get anyone to pay attention after that. Follow-on results pretty much confirmed the original result though. (Astrobiology was my field ~10 years ago.)
- gus_massa 6y agoDo you have any link with more info? The Wikipedia page is not very optimistic https://en.wikipedia.org/wiki/Allan_Hills_84001 https://en.wikipedia.org/wiki/Allan_Hills_84001
- garmaine 6y agoHere's one from 2010: https://spaceflightnow.com/news/n1001/09marslife/ https://spaceflightnow.com/news/n1001/09marslife/ I think there's a more recent book that came out a few years ago, but a quick google search isn't finding the name, sorry. For Wikipedia which relies on citations, it's going to reflect the majority opinion which is "ALH84001 is insufficient evidence for life." However the reasoning for saying that morphological features are insufficient signs of life (in contrast with biologists studying Earth life who routinely rely on such evidence) is actually a direct response to ALH84001. Like the Pluto-Is-A-Planet? debacle, the generally accepted requirements and definitions were drawn up after the fact specifically to exclude ALH84001, in order to end an embarrassing controversy and provide funding for more missions (why go to Mars when you can just pick up rocks in Antarctica instead?) rather than answer a scientific question.
- RcouF1uZ4gsC 6y agoThis article is way too sanguine about this. Scientists putting forth a hypothesis, getting peer reviewed, getting published, and then having others fail to replicate their findings is absolutely a normal part of science. However, touting very surprising, very unsure results using the megaphone of media, is not science. It is clickbait. It is BS. And it is intensely damaging to science. What happens is there is a selection effect. The most surprising findings are the ones that are most likely to be touted by the media. However, the most surprising results are the most likely to be wrong. So over time, you end up with the result that much of the "science" touted by the mainstream media ends up being wrong. And we cannot just blame this phenomenon on the media. Many times it is the institutions that are supporting the research that are contacting the media and putting out press releases and getting on twitter with very clickbaity summaries of the research. It is great for the scientist. It makes them famous for a day. And as with most stories, the original story gets a lot more play than the correction. However, it is very damaging to our society. The regular person sees science as a stream of exciting results that are later proven wrong. All the while people are shouting, "This is fine, because this is how science works." And it damages trust. Imagine if you went to your doctor for a routine blood test and the doctor came back and said, "You have an elevated white blood cell count. This could mean you have cancer." Then a couple of days later, you got called back in to be told, "Well actually, the count was increased because you likely had a cold. But this is how medicine works. One test can suggest something, but different tests can give a different explanation." If this scenario happened on a regular basis, your confidence in medicine would really be messed up. If we present science as this ever changing, always being proven wrong entity, then how can we ask people to depend on "science" and make potentially very expensive and inconvenient adjustments to their lives such as with COVID or climate change?
- kodyo 6y agoPoliticizing scientific results is more damaging than publicly falsifying them. I'd worry more about that. Once something is politicized, it's harder for the red/blue teamers to incorporate new data that shows it to be false.
- pessimizer 6y agoThey can't, and won't. They'll choose to believe what they want to believe. Who can blame them when horseshit is constantly being published and publicized, often by supposedly reputable journals. It was the Lancet that started anti-vax.
- SubiculumCode 6y agoI now promise myself I will never read the comments on an HN Science article going forward. The sheer number of individuals here who presume scientists are idiots, that the decisions they make are dumb or ill- motivated demonstrates the sheer hubris and lack of humility of a large portion of HN commenters. I guarantee you that scientists are as smart and capable as the best of the non-scientist HN population, and were the story roles reversed, that scientists on the whole would be more humble about the limits of their knowledge about programming practice and design, etc. They would not revel in the "idiocy" of your bugs, security lapses, or petty spy-based mobile apps. Well maybe the last. Have some humility. Stop building up fragile egos by tearing others down, pretending that you wouldn't make similar "mistakes" or produce designs with similar weaknesses or limits. Edit 1:Yes I'll defend my tribe. Each down-vote is a badge.
- dekhn 6y agoI spent a couple decades as a scientist. I was modestly successful, published only work that I believe was truly defensible, and never over sold any of my results. I've asked to have my name removed from a paper that was submitted when I noticed it was revised to include lies after I had written it. I believe you are wrong in saying that scientists aren't idiots: they make colossal errors, obvious ones, all the time! Frankly, I think most successful (in terms of adulation and $$$) scientists are ones who learned how to play the games scientists play, and publish known incorrect work, or unknowingly publish overly strong estimates of their confidence, because they've mastered the incentive system, not because they're not idiots. I see very little true humility amongst scientists- nearly every successful one I've met was aggresively egotistical. That said, after another 10-15 years of being a SWE, I've come to the conclusion most SWEs are idiots, too- too focused on clever algorithms and microoptimizations.
- SubiculumCode 6y agoWe are all idiots to some degree, scientists are no exception. But I firmly disagree with your assessment of the state of science and scientists. Improvements to be made? Certainly.
- deleted 6y ago
- skc 6y agoI bet the people that sensationalize this sort of thing would generate just as much excitement if they led with a huge disclaimer.
- dash2 6y agoI think "show just how science works" has become a bit of a meme for "we need to roll back this mistaken/over-ambitious claim". I googled for some evidence: Our climate data was wrong, which shows how science works: https://scripps.ucsd.edu/news/research-highlight-pointing-out-flaws-climate-change-data-two-studies-show-how-science-works https://scripps.ucsd.edu/news/research-highlight-pointing-ou... Re the replication crisis: "Negative opinions about psychology as a science already exist. We have the opportunity to show how science works by directly investigating and addressing the problems." https://www.psychologicalscience.org/observer/champions-of-psychological-science-brian-nosek/comment-page-1 https://www.psychologicalscience.org/observer/champions-of-p... I didn't find any others, but if you doubt my thesis, that's just the magic of science at work!
- kenjackson 6y ago> I think "show just how science works" has become a bit of a meme for "we need to roll back this mistaken/over-ambitious claim". You say this as if it's a small feat. The willingness to rollback a claim you made, ambitious or mundane, is surprisingly difficult for people to do. Most of science is about making claims based on the best evidence that you have with some level of confidence. Where we run into problems, just look in the news, is when claims become invariant, regardless of new data, methods, theories.
- dnautics 6y agoYou're arguing past GP. It's one thing to be mistaken for subtle or deep reasons and say "this is how science works". It's another to be sloppy and say "this is how science works". I'm not even saying scientists shouldn't ever be sloppy, you should definitely start sloppy and there's also a sense in which if observations are reproducible across sloppy setups it's more robust - but also, maybe one should not take out a headline-grabbing presser based on sloppy or shaky work. And it's hard to argue that the social structure of contemporary scientific discovery doesn't incentives this sort of sloppiness.
- dragonwriter 6y ago
- redis_mlc 6y agoOh look. Another HN UFO and aliens thread. People often ask what HN was like in the good old days. I don't remember drivel like this in the first 5 years. I think the underlying reason for these types of threads is that HNers want to virtue signal that they're interested in science, but too lazy to do the actual study and work to understand and contribute. Pro tip: just follow the Twitter NASA channel. You'll get pretty pictures, with no real effort. An analogy is when the Linux kernel team started a kernel newbie project, and got nothing but white space patches. So the project had to be abandoned because of low quality and the burden of wasting time for, you know, actual kernel contributors.