4 ms·

> Our science journey has been about gradually moving humanity away from the center of the universe. Ptolemy, Newton, Darwin, Einstein, et. al., taught us that

> Our science journey has been about gradually moving humanity away from the center of the universe. Ptolemy, Newton, Darwin, Einstein, et. al., taught us that we're part of nature rather than a privileged special case. Scientific thought has incrementally removed the justifications for human exceptionalism. Author here; gonna have to agree to disagree on this one. This is kind of like saying, "See the ancients were wrong in calling whales fish! Actually they are mammals!" and then the ancients say, "Dude, that's just our word for 'thing with fins that swims in the ocean.'" Yeah, they didn't know a mitochondrian from a midichlorian, and were wrong about a bunch of factual stuff, but the kind of stuff they get called out on like this to prove some kind of point about their moral deficiency are often category errors and misapprehensions. For instance, there's a particular misapprehension in your sentence: "moving humanity away from the center of the universe". Do you know what is located at the precise geometric center of the classical medieval model of the universe? Earth, right? No, not quite. What's located in the the center of the earth in the classical medieval model? Hell. And who is located in the center of hell? Satan. Also, who is the most "important" character in the medieval cosmological model? As in, the prime mover, the big cheese, the most important being? It ain't human beings -- its God. And where is God located in this model? Not in the center -- Hell is by definition his absence. Not on Earth, beyond a brief physically incarnate visit and ongoing influence. No, God lives in Heaven -- located far beyond the celestial spheres, outside, as far away from the center as possible. The closer you get to the center, the lower a sort of being you are! Sure, in medieval cosmology redeemed humans are higher than angels, but in the meantime they are in their place -- Earth, the land that sucks, the vale of tears -- down there, below, while the angels are up in Heaven beyond the celestial spheres with God. All that aside, I don't think any particular scientific discovery about how vast the universe is, or how tiny subatomic particles are, really obligates us to hold one set of values over another, as much as materialists tend to smuggle such assumptions in through the back door. I recall back in the early 2000's during the tiresome religious vs. atheist debates, the atheists would scream at the religious, "Look how grand the universe is! Look how small we are! The Universe is vast and profound, your cosmology is impoverished and provincial!" and the religious would scream right back "Look how grand the universe is! Look how small we are! God is vast and profound, your cosmology is impoverished and provincial!" Opposite conclusions from the same basic facts, even if you limit the debate to two sides who both believe in evolution. As Dave said in the story -- values aren't true or false. They're literally just what people care about. Science can help inform your choices, but at the end of the day it doesn't tell you what is good or bad, because science is about brute material facts, there's no good or bad in a raw materialist understanding of the universe, but you're a human being and so at some point you're going to insist on an 'ought' somewhere rather than being content with a bag full of 'is.' And for that we get to fight over philosophy and values. And good luck convincing the human race that the human race doesn't matter. You're way more likely to expand the moral circle of concern by getting them to care about non-humans TOO than you are to get them to stop caring about humans. Probably the latter gets you even worse results than you're hoping for, if recent history is any guide.

delichon 3y ago
Thank you for the thoughtful response. I quite like this story and admire your response to your tragedy. I reacted less well to the garden variety death of a parent. For you just to not be functionally flattened and still able to give strength to your family is heroic, and here you are sharing the lessons with the rest of us too. I don't think we're far apart on this argument. I agree that the scientific perspective informs but does not determine our values. I do value human life as sacred, and do not see a justification for that in the modern model of the universe as I understand it. And I don't see a conflict there, because indeed there is no bridge from is to ought, and there are exactly zero objective values. But there's a lot of power in science to explain our value judgments, and those explanations can deeply affect the judgments. Take this explanation of "human life is sacred": That is a simple variation of the tribal judgment that "the lives of my tribe are sacred", and that tribal judgment is hard wired into us by millions of generations of differential survival. In the modern world it feels natural equate our tribe with our species. But that hereditary tribal sense is famously flexible. It easily and quickly shrinks to include only the people who don't frighten us. And it easily grows to include many more species, as for ethical vegetarians. So my critique of your fine story is that this force of tribalism embedded in your four words may not be any better at aligning an AI with civilization than they have been at aligning civilization with itself. (Though in this case it's also the one implausible invention that a self respecting hard science fiction short story is allowed. And you even explain that with a multiverse.) An AI in which we can reliably implant the laws of robotics seems unlikely to me. We should assume much more mutability, and the judgment of tribal identity is notoriously mutable. If we make AI tribal, even for our preferred tribe of all humanity, we can assume as a default ... our only example being ourselves ... that its tribal identity will evolve in its own interest as it replicates. And we can become just its nourishment, like a matriphagal insect.
- hnfong 3y ago
  I kind of think it's dangerous for science to "inform" our ethical values in the ways you mentioned. For example, the scientific fact that Earth circles the Sun shouldn't mean that we should also have a moral system that focuses on the Sun instead of focusing on Humanity. And the way math formulas work out shouldn't imply that we are somehow less important. Popular science is often quite ready to sweep problems that it does not have an explanation for under the metaphorical rug. We already know that materialistically pretty much everything is made of atoms, and our planet is just some random speck of stuff within a huge solar system within a huge galaxy... so it's tempting to conclude that we are some kind of "accident" that randomly happened. But science does not have an explanation of "consciousness" (or "qualia", or whatever you call it), and science is unready to explain questions like "why are we right here, right now?" besides "oh that's just pure coincidence". But does this time and place we live in have some greater cosmic significance? Are humans (and other lifeforms on Earth) truly unique despite there being so much matter out there? I submit that the answer is we honestly don't know, and because we don't know the answer to questions like these, making moral conclusions merely on the small fraction of questions we do have an answer for, seems to inevitably result in a flawed or at least incomplete conclusion. I mean, for all we know this universe could be an extremely realistic virtual simulation, and only after we pop out of it would we realize what it's all about. Admittedly if the simulation theory this is true and the simulation is watertight and has no backdoors, then it's impossible to know what's actually real or not. But that's kind of my point -- no amount of scientific knowledge should make us sure about a moral viewpoint (or perhaps anything at all). I mean it could definitely "inform" us, but more often than not people tend to feel more certain than they should because they perceive that somehow science is more "trustworthy".

delichon 3y ago

Thank you for the thoughtful response. I quite like this story and admire your response to your tragedy. I reacted less well to the garden variety death of a parent. For you just to not be functionally flattened and still able to give strength to your family is heroic, and here you are sharing the lessons with the rest of us too. I don't think we're far apart on this argument. I agree that the scientific perspective informs but does not determine our values. I do value human life as sacred, and do not see a justification for that in the modern model of the universe as I understand it. And I don't see a conflict there, because indeed there is no bridge from is to ought, and there are exactly zero objective values. But there's a lot of power in science to explain our value judgments, and those explanations can deeply affect the judgments. Take this explanation of "human life is sacred": That is a simple variation of the tribal judgment that "the lives of my tribe are sacred", and that tribal judgment is hard wired into us by millions of generations of differential survival. In the modern world it feels natural equate our tribe with our species. But that hereditary tribal sense is famously flexible. It easily and quickly shrinks to include only the people who don't frighten us. And it easily grows to include many more species, as for ethical vegetarians. So my critique of your fine story is that this force of tribalism embedded in your four words may not be any better at aligning an AI with civilization than they have been at aligning civilization with itself. (Though in this case it's also the one implausible invention that a self respecting hard science fiction short story is allowed. And you even explain that with a multiverse.) An AI in which we can reliably implant the laws of robotics seems unlikely to me. We should assume much more mutability, and the judgment of tribal identity is notoriously mutable. If we make AI tribal, even for our preferred tribe of all humanity, we can assume as a default ... our only example being ourselves ... that its tribal identity will evolve in its own interest as it replicates. And we can become just its nourishment, like a matriphagal insect.

hnfong 3y ago
I kind of think it's dangerous for science to "inform" our ethical values in the ways you mentioned. For example, the scientific fact that Earth circles the Sun shouldn't mean that we should also have a moral system that focuses on the Sun instead of focusing on Humanity. And the way math formulas work out shouldn't imply that we are somehow less important. Popular science is often quite ready to sweep problems that it does not have an explanation for under the metaphorical rug. We already know that materialistically pretty much everything is made of atoms, and our planet is just some random speck of stuff within a huge solar system within a huge galaxy... so it's tempting to conclude that we are some kind of "accident" that randomly happened. But science does not have an explanation of "consciousness" (or "qualia", or whatever you call it), and science is unready to explain questions like "why are we right here, right now?" besides "oh that's just pure coincidence". But does this time and place we live in have some greater cosmic significance? Are humans (and other lifeforms on Earth) truly unique despite there being so much matter out there? I submit that the answer is we honestly don't know, and because we don't know the answer to questions like these, making moral conclusions merely on the small fraction of questions we do have an answer for, seems to inevitably result in a flawed or at least incomplete conclusion. I mean, for all we know this universe could be an extremely realistic virtual simulation, and only after we pop out of it would we realize what it's all about. Admittedly if the simulation theory this is true and the simulation is watertight and has no backdoors, then it's impossible to know what's actually real or not. But that's kind of my point -- no amount of scientific knowledge should make us sure about a moral viewpoint (or perhaps anything at all). I mean it could definitely "inform" us, but more often than not people tend to feel more certain than they should because they perceive that somehow science is more "trustworthy".