5 ms·
Moral judgments can be altered ... by magnets
- SlyShy 17y agoThis doesn't surprise me, but it does have worrying ethical implications. What if there were a machine to make everyone moral? Would it be immoral to use it? Or would be immoral not to? Edit with expansion of scenario, so it is clearer what I'm getting at: The situation I envision is a machine that can be programmed to produce some set of "morality" as it were. Who gets to decide what the moral system is, and who it is applied to? Certainly we wouldn't want a corporation or an unelected body to do it. But we also think the machine would be useful in reducing senseless tragedy like murder.
- jjs 17y agoUse the machine on yourself first. Then you're guaranteed to make the moral decision.
- SlyShy 17y agoI'll give you props for the clever answer that circumvents the question. ;)
- xenophanes 17y agoIt's a good answer, not just clever. The issue he's addressing, clarified, is, "What if we had a source of infallible (moral) knowledge?" Then, "ask that source, not me, you, or any other fallible human" is not just clever but correct. However, infallible sources of knowledge badly violate everything we know about epistemology. So don't expect to actually find one. What interests me more is this issue: If I had a magnet that made people act a certain way, and I thought that certain way was moral/good, then should I use it on people? The answer then is no, in the event that I disagree with someone about what's good, I shouldn't force them with magnets; it could be me who is mistaken not them. I should instead persuade them to use the magnet voluntarily. What's good about a discussion with attempted persuasion is it could go either way. I could end up persuaded, or him. This is different than using the magnet which can't go either way, so if it's a mistake there's no possibility of it being corrected.
- randallsquared 17y agoThe issue he's addressing, clarified, is, "What if we had a source of infallible (moral) knowledge?" Er, that's not a clarification of "The situation I envision is a machine that can be programmed to produce some set of "morality" as it were." It's a completely different thing.
- xenophanes 17y ago> What if there were a machine to make everyone moral? is the issue addressed by jjs
- randallsquared 17y agoBut since SlyShy started the thread, and jjs replied to him, I think I'll go with SlyShy's expansion of what he meant. Feel free to choose for yourself what SlyShy was talking about, but let's not confuse things by bringing jjs into it, hm? ;) Edit: aaaand I missed that the poster you were replying to was also SlyShy, changing the point of your comment. Nevermind me. Let's move along. Nothing to see.
- pierrefar 17y agoWon't work. You have to choose the machine's moral decision outcome before you use it, which means that you're making the decision while still "immoral" (for the lack of a better word).
- xenophanes 17y agoThe question "What if there were a machine to make everyone moral?" implicitly assumed it would make people moral, whatever that is, as a premise, rather than moral according to someone's judgment. This reading may be debatable, but I think that's how he took it.
- hugh3 17y agoI suppose behaving morally is two problems, then: a) Deciding what is moral, and b) Doing it even if you don't want to. A machine which helped you do (b) would be useful even if it couldn't do (a).
- a-priori 17y agoThis isn't about changing how likely someone is behave morally, this is about changing the criteria they use for making moral decisions. Specifically, they're knocking out the ability to use theory of mind to guess a person's intentions.
- TNO 17y agoWho needs a machine when drugs are so popular? Ritalin to make kids behave, Antidepressants to make people more lively, Amobarbital to make people honest, etc. Morals are a fickle thing and I don't see how any meaningful conclusion can be made from asking the question. "How moral is an atomic bomb?" is just as meaningless a question to ask.
- j-g-faustus 17y agoSounds like you are assuming that "moral" is an exact concept. Practically speaking, there seems to be lots of cases where opinions on what is moral differ: Abortion, porn, finance... What would worry me with a machine that could tweak everyone to the same 'standard' moral is who gets to decide what that standard is: Having my moral controlled by the porn industry, Goldman Sachs or the religious right all seems equally bad. I like my moral just the way it is, thank you :)
- SlyShy 17y agoNo, actually, that's part of what makes this question interesting to me. The situation I envision is a machine that can be programmed to produce some set of "morality" as it were. Who gets to decide what the moral system is, and who it is applied to? Certainly we wouldn't want a corporation or an unelected body to do it. But we also think the machine would be useful in reducing senseless tragedy like murder.
- sigstoat 17y agoi think one's capacity for self delusion/rationalization vastly outweighs whatever one's moral compass is telling them to do. before you went applying this to folks' brains, you could poll convicted criminals to determine what sort of morality they're operating off of, and see if it even differs statistically from the population as a whole. i'd be surprised if it did. perhaps someone has already studied this? any ideas?
- tokenadult 17y agoyou could poll convicted criminals to determine what sort of morality they're operating off of, and see if it even differs statistically from the population as a whole. There have been studies of this nature. I recall seeing a report about such interviews with criminals quite a long time ago, on the United States television program Sixty Minutes. Convicted criminals generally use considerably different moral reasoning from typical members of the public without criminal records. One example: a prison inmate was asked how he felt about taking other people's possessions. He replied, "I think of it as MY thing, not his thing."
- drawkbox 17y agoAmazing stuff. Kinda out there... I always thought that maybe the earth's magnetic fields can affect cultures in different areas of the world, leading to different morals really. I wonder how much this can affect thinking processes and learning as well? For instance why do cultures on the other side of the world all write seemingly backwards or from the other side? Russian seems like it is upside down and backwards to English. Is it just relative cultures or some forces pushing things to feel natural differently depending on where you are in various fields.
- a-priori 17y agoWhoa there, this isn't the kind of magnet you find on your fridge door. TMS uses pulses (not static fields) from a 2 tesla magnet. For comparison, the Earth's magnetic field is 31 µT and a fridge magnet is 5 mT. But, the fact that it's a pulse is the more important than the field strength: the goal is to produce a current in the brain via Faraday's law. In order to do that, you need a magnetic flux, and therefore a rapid change in the field strength. Sitting in a magnetic field, no matter how strong, is not going to induce a current. tl;dr: Any theories about the Earth's magnetic field affecting moral judgement are bull. Ditto for everyday magnets. (Correction: I just read the paper. They used a 3T field in this study, not 2T.)
- cj 17y ago"When you open your mind to the impossible, sometimes the truth is revealed"
- gxs 17y agoI've always wondered if perhaps there is something to astrology after all. While I can't say I believe in it, what if the earth's magnetic field at different times of the year affects the way the brain develops? The possibilities are endless!
- ajj 17y agoI suspect this comment would not have been downvoted had it not mentioned the word "astrology".
- hugh3 17y agoReally? It would still be pretty disconnected from reality, mostly because: a) The Earth's magnetic field is incredibly weak compared to anything you'd get from transcranial stimulation, and b) The Earth's magnetic field doesn't change significantly over the course of the year.
- tokenadult 17y agoOne of the great things about transcranial magnetic stimulation http://en.wikipedia.org/wiki/Transcranial_magnetic_stimulation http://en.wikipedia.org/wiki/Transcranial_magnetic_stimulati... in general is that it is a treatment that can be evaluated in placebo-controlled studies, because it is possible to put patients into convincing sham treatments. http://norvig.com/experiment-design.html http://norvig.com/experiment-design.html Transcranial magnetic stimulation needs a LOT more research, but if treatment protocols can be refined through that research, it holds promise for improving outcomes in some patients with mood disorders and perhaps other difficulties related to abnormal brain function.
- joeyo 17y agoIs that actually the case? I'm of the impression that TMS systems 1) are audibly noisy when in use and 2) evoke activity in the scalp that can be perceived by the subject ("tingling"). Admittedly, adding sham noise would be fairly easy, but I am not sure what countermeasures are possible if the subject can "feel" when TMS is active.
- tokenadult 17y agoI read in a medical text that sham treatments are possible, but I didn't see there details of what must be done to make the sham indistinguishable from the studied treatment. I don't recall seeing anything about feelings in the scalp of patients when I read that source.
- a-priori 17y agohttp://www.plosone.org/article/metrics/info:doi/10.1371/journal.pone.0001923 http://www.plosone.org/article/metrics/info:doi/10.1371/jour...
- tokenadult 17y agoGREAT article, perfectly on-point to the follow-up question about my comment. Thanks.
- 17y ago
- th 17y ago"In both experiments, the researchers found that when the right TPJ was disrupted, subjects were more likely to judge failed attempts to harm as morally permissible." This statement is meaningless without knowing how much more likely the attempts were and what the error range was for the results.
- scott_s 17y agoAll of that is likely in their academic paper, but it is behind a pay-wall: http://www.pnas.org/content/early/2010/03/11/0914826107.abstract http://www.pnas.org/content/early/2010/03/11/0914826107.abst...
- randomwalker 17y agoHere: http://randomwalker.info/misc/PNAS-2010-Young-0914826107.pdf http://randomwalker.info/misc/PNAS-2010-Young-0914826107.pdf
- a-priori 17y agoI have a copy of the paper if anyone is interested. My email is in my profile if you want to read it. The short story is that there's no good answer to the question of likeliness to make a moral decision based on theory of mind, because they scored the results on a 7-point scale of permissible vs. forbidden. But, their error margins are very good. Here is an exert from the combined analysis of the two experiments: "TMS site specifically affected judgments of attempted harms: TMS to the RTPJ vs. the control site resulted in participants’ judging attempted harms as more permissible [independent samples t test based on the item analysis: t(87) = 3.6, P = 0.001]."
- shawndumas 17y agohttp://www.youtube.com/watch?v=-M-vnmejwXo http://www.youtube.com/watch?v=-M-vnmejwXo
- greenlblue 17y agoumm... Am I the only one that sees something wrong with this? We'll mess with your brain's ability to function and then give you some kind of test to see if indeed your brain is malfunctioning in some way. This is just retarded. I'd go as far as to say the region of the brain that the magnet is pointed at has nothing to do with morality. All they are doing is hindering the brain to do what it usually does.
- _delirium 17y agoYeah, these kinds of things are usually massively oversold as if we have the ability to precisely control things about the mind by poking at the brain, despite understanding the relationships pretty poorly. Usually it's more like trying to change how your web-browser operates by soldering on your motherboard: sometimes you'll get lucky and actually do something, but usually you'll either break it or cause generalized weirdness.
- cj 17y agoBreaking some normal function by applying a specific set of conditions to the brain is where a large portion of our medical discoveries stem. Even if findings from this research do not give us any new practical knowledge in everyday life, coupled with other similar, seemingly trivial findings, could facilitate major breakthroughs in the future.
- a-priori 17y agoBut the key is that the brain is impaired in very specific ways. If you asked the person to do any task that was not a moral judgement and did not use theory of mind, they would be unaffected. This is how the brain works: manipulating certain parts (e.g. by injury or, as in this case, stimulation) of the brain impairs certain capabilities while leaving the remainder intact. If you put this in another part of the brain the person might not be able to move their right arm, or might hallucinate faces, or their personality might change. The incredible thing is how specific the changes are.
- greenlblue 17y ago
- Jach 17y agoI remember seeing this before... Humans have very malleable morals. Even just the phrasing of moral questions can alter judgments far more than these magnets: http://books.google.com/books?id=igN6Q9weoYQC&pg=PA39&lpg=PA39&dq=tamarin+joshua&source=web&ots=UU-Z3a1IWn&sig=INNgmxQHyvvdF_00Z4W3zH0O_sY&hl=en&sa=X&oi=book_result&resnum=3&ct=result#v=onepage&q=tamarin%20joshua&f=false http://books.google.com/books?id=igN6Q9weoYQC&pg=PA39...
- indigoviolet 17y agoof course they can, that's how the moral compass works.