17 ms·
The worst thing about being smart is how easy it is to talk yourself into believing just about anything. After all, you make really good arguments. EA appeals
by jfengel 4y ago
The worst thing about being smart is how easy it is to talk yourself into believing just about anything. After all, you make really good arguments.
EA appeals to exactly that kind of really-smart-person who is perfectly capable of convincing themselves that they're always right about everything. And from there, you can justify all kinds of terrible things.
Once that happens, it can easily spiral out from there. People who know perfectly well they're misbehaving will claim that they aren't, using the same arguments. It won't hold water, but now we're swamped, and the entire thing crumbles.
I'd love to believe in effective altruism. I already know that my money is more effective in the hands of a food bank than giving people food myself. I'd love to think that could scale. It would be great to have smarter, better-informed people vetting things. But I don't have any reason to trust them -- in part because I know too many of the type of people who get involved and aren't trustworthy.
- JohnFen 4y agoEffective Altruism is just a modern iteration of a thing that's been around for a very long time. The fundamental idea is sound. However, in practice, it all-too-easily devolves into something really terrible. Especially once people start down the path of thinking the needs of today aren't as important as the needs of a hypothetical future population. Personally, I started "tithing" when my first business was a success. In part because it's good to help the less fortunate, but also as an ethical stance. Having a business drove home that no business can be successful without the support of the community it starts in, so it's only right to share in the rewards. So, I give 10% back. I have rules about it: I always give to a local group who directly helps people and who is typically overlooked for charitable giving. I get to know the group pretty well first. I never give to any group that won't keep my identity a secret. I never give to any group that asks me for money. I don't always give in the form of money. Sometimes, it's in the form of my time and effort, or in material goods, etc. I don't give to "umbrella" groups whose purpose is fundraising for a collection of other groups. This isn't because I have a problem with them, but because they're not the ones who struggle the most to get donations.
- pdonis 4y ago> I get to know the group pretty well first. I think this is a very, very, very important step. What's more, it's a step that I don't think can be outsourced to someone else, which is why I'm skeptical about claims by, among others, the Effective Altruism movement, to be able to do this kind of thing on your behalf.
- gruez 4y ago>What's more, it's a step that I don't think can be outsourced to someone else, which is why I'm skeptical about claims by, among others, the Effective Altruism movement, to be able to do this kind of thing on your behalf. Why can't this be done? Society in general outsources due diligence to third parties all the time. Banks outsource credit worthiness assessments to credit bureaus. Passive investors outsource price discovery to other market participants. Online shoppers outsource quality control to reviewers. I agree that there's no substitute for doing it yourself, but it's simply not realistic in many cases to do the due diligence yourself. Even if you do it yourself, there's no guarantee that you'll do a better job than the professionals.
- boucher 4y agoIt sounds like a nice idea, but I don't think it's a very practical one. It drives away anyone who wants to give but is unable or unwilling to devote the kind of time necessary to do this kind of in-depth research (the amount of which only goes up the more money you want to give away).
- dfgheaoinbt6t 4y ago>Especially once people start down the path of thinking the needs of today aren't as important as the needs of a hypothetical future population. It's not that that bothers me so much as the fact that many effective altruists do it so badly. We need to be concerned with the future. That is the only reason to maintain roads and bridges, to prevent pollution, or to conserve resources like water in aquifers and helium. But effective altruists are as likely to talk about colonizing Mars as they are to talk about global warming. Effective altruism is supposedly about making evidence-based decisions. We have no idea how likely "existential risks" are. We have no idea what, if anything, can be done about them. We cannot predict a year into the future, let alone millenia. So-called longtermism is nothing more than guesswork.
- dfgheaoinbt6t 4y agoEffective altruism is, I think, an ideology perfectly suited to ensnare a certain kind of person. Conventional wisdom would say that wielding wealth and power like effective altruism demands requires humility, compassion, and maturity. It requires wisdom. Effective altruism can seem to remove the need for that. Doing good is about calculation, not compassion! Interpersonal failings don't matter if someone is really good with C++. One needn't care about the feelings of others if there are more efficient ways to use the time. Effective altruism calls on the rich and capable to recognize their own power to help those who are poor and helpless. However, it is easy for pity to turn to contempt and for clarity of purpose to turn to arrogance. The poor, hungry, and sick of the world need the effective altruist for a savior. The effective altruist is better than the rest because they are making the world a better place. An effective altruist may confuse immaturity with wisdom and greed with generosity. This is not meant to be a diatribe. I find much of effective altruism obviously true and find my exposure to it has made me a better person. If pressed, I would probably call myself an effective altruist. Still, it is greatly concerning that people like Elon Musk or Sam Bankman-Fried can be associated with effective altruism without any real hypocrisy.
- gruez 4y agoYour point seem superficially valid, but where do we go from there? >The worst thing about being smart is how easy it is to talk yourself into believing just about anything. After all, you make really good arguments. >EA appeals to exactly that kind of really-smart-person who is perfectly capable of convincing themselves that they're always right about everything. And from there, you can justify all kinds of terrible things. Should we not talk ourselves into believing into stuff? Should smart people specifically avoid changing their beliefs out of fear of "justify all kinds of terrible things"? >I'd love to believe in effective altruism. I already know that my money is more effective in the hands of a food bank than giving people food myself. I'd love to think that could scale. It would be great to have smarter, better-informed people vetting things. But I don't have any reason to trust them -- in part because I know too many of the type of people who get involved and aren't trustworthy. So you don't trust donating money to food banks or malaria nets because "don't have any reason to trust them", then what? Don't donate any money at all? Give up trying to maximize impact and donate to whatever you feel like donating to?
- AnIdiotOnTheNet 4y ago> Should we not talk ourselves into believing into stuff? Should smart people specifically avoid changing their beliefs out of fear of "justify all kinds of terrible things"? It's simple really: just be skeptical of your own reasoning because you're aware of your own biases and fallibility. Be a good scientist and be open to being wrong. > So you don't trust donating money to food banks or malaria nets because "don't have any reason to trust them", then what? No, they don't trust that you can scale the concept of "food banks are more effective than I am" to any kind of maximization. You can still donate to worthy causes and effective organizations. > Don't donate any money at all? Give up trying to maximize impact and donate to whatever you feel like donating to? Yeah, basically. Giving is more helpful than not giving, so even a non-maximalist approach is better than nothing. Perfect is the enemy of good, aim for good.
- gruez 4y ago>It's simple really: just be skeptical of your own reasoning because you're aware of your own biases and fallibility. Be a good scientist and be open to being wrong. This just seems like a generic advice to me which is theoretically applicable to everyone. Is there any evidence of effective altruists not doing that, or this being specifically a problem with "really-smart-person"s? >No, they don't trust that you can scale the concept of "food banks are more effective than I am" to any kind of maximization. You can still donate to worthy causes and effective organizations. I'm not quite understanding what you're arguing for here. Are you saying that you disagree with effective altruists' assessment that you should be funding malaria nets in africa or whatever (ie. what they want you to do), rather than donating to local food banks (ie. what you want to do)? >Yeah, basically. Giving is more helpful than not giving, so even a non-maximalist approach is better than nothing. Perfect is the enemy of good, aim for good. To be clear, you're arguing for donating for whatever your gut tells you, rather than trying to maximize benefit?
- PragmaticPulp 4y ago> EA appeals to exactly that kind of really-smart-person who is perfectly capable of convincing themselves that they're always right about everything. And from there, you can justify all kinds of terrible things. I came to the same conclusion after a group of my friends got involved with the local rationalist and EA community, though for a different reason: Their drug habits. They believed themselves to have a better grasp on human nature and behavior than the average person, and therefore believed they were better at controlling themselves. They also had a deep contrarian bias, which turned into a belief that drugs weren’t actually as bad as the system wanted us to believe. Combine these two factors and they convinced themselves that they could harness recreational opioid use to improve their lives, but avoid the negative consequences that “normies” suffered by doing it wrong. I remember being at a party where several of them were explaining that they were on opioids right now and tried to use the fact that nothing terrible was happening as proof that they were performing rational drug use. Long story short, the realities of recreational opioid use caught up with them and they were blind to the warning signs due to their hubris. I intentionally drifted away from that group around that time, so I don’t know what happened to them. I will never forget how confident they were that addiction is something that only happens to other people, not rationalists like them.
- DaveExeter 4y ago>recreational opioid use Horse? Were they shooting horse?
- telotortium 4y agoNo, they should have listened to their parents! Drug positivity is supposed to be reserved for cannabis and hallucinogens!
- teraflop 4y agoI'm reminded of a fascinating series of Reddit threads, starting back in 2009, from somebody who convinced himself he "could handle anything once" and decided to try heroin, only to rapidly spiral out of control: https://www.reddit.com/r/BestofRedditorUpdates/comments/wef6hn/the_saga_of_an_average_guy_who_spontaneously/ https://www.reddit.com/r/BestofRedditorUpdates/comments/wef6...
- bena 4y agoI wouldn't say "really-smart-person" but reasonably smart person who believe they are way more intelligent than they actually are. People who mistake competence in one area as expertise in all areas.
- ben_w 4y ago> EA appeals to exactly that kind of really-smart-person who is perfectly capable of convincing themselves that they're always right about everything. And from there, you can justify all kinds of terrible things. Yup. Which is super-ironic given the association with big-R Rationality, Less Wrong, Overcoming Bias, all of which quote Feynman saying "The first principle is that you must not fool yourself, and you are the easiest person to fool." Now I have the mental image of the scene in The Life of Brian where the crowd mindlessly parrots Brian's call for them to think for themselves.
- twblalock 4y agoThis observation is correct, and it applies to any kind of consequentialis/utilitarian reasoning in general.
- roenxi 4y agoLet us take a moment and separate the idea from the community - most (I might potentially say all) communities fail to embody their own ideas. A fun one is giving any religious community 100 years and then checking in to see how they are going at avoiding scandals. Effective altruism the ideal is very easy to defend - it is blindingly obvious that economic advancement has outperformed all attempts at charity by orders of magnitude. Asian countries keep using work-hard-and-save with jaw dropping outcomes. The success rate of capitalist entrepreneurs at driving social improvements dwarfs the attempts of charities too. The Effective Altruist community however is probably going to devolve into something rather unimpressive. There isn't much difference between a high performing effective altruist and a successful capitalist, so the community is on shaky ground. They don't have obvious rituals or demographic pressures to keep the community congealed. Although this headline confuses me. Don't all communities with men in them have a sexual harassment problem? I'm not recalling a community that I'm eligible to join that hasn't been labelled as having sexual harassment problems.
- staunton 4y agoI guess this has to do with people trying for (in any sense) "higher standards" being perceived as hypocrites when they fail to meet them. Whenever you have a movement that claims to be "trying to make things better", you will be attacked for having any problems even if everyone else also has those problems. In some sense, I think this idea is even valid. "You're trying to be better so why are you not better at this particular thing?" seems like a reasonable question. It's just sad when this is used as a general argument against trying to improve things.
- neilv 4y ago> The worst thing about being smart is how easy it is to talk yourself into believing just about anything. What about if you're less smart? Wouldn't you be more easily fooled? Maybe it's not about smartness, but about arrogance?
- rcoveson 4y ago> The worst thing about being smart is how easy it is to talk yourself into believing just about anything. After all, you make really good arguments. How smart you are has nothing to do with it. If you're motivated enough to believe something that you shouldn't believe, you'll talk yourself into it. Smart people might be able to come up with an objectively better (or at least more convoluted) rationalization, but only because they'll require of themselves a better rationalization. Less-smart people won't be as capable of rationalizing, but they also won't be as discerning about the quality of the rationalization. Kind of like how people develop about the right amount of muscle to carry their own weight around, whether that be 90 or 180 lbs. > EA appeals to exactly that kind of really-smart-person who is perfectly capable of convincing themselves that they're always right about everything. This sounds negative until you realize this also applies to programming and litigation, chess and go, everything in academia, communism and anarcho-capitalism, etc. The fact that something appeals to know-it-alls says next to nothing about the quality of the thing. Chess isn't a worse game because it attracts insufferable braniacs and other pretentious people, it's just the community around it that suffers. But the communities around everything interesting suffer from those same sorts of people. > And from there, you can justify all kinds of terrible things. > Once that happens, it can easily spiral out from there. People who know perfectly well they're misbehaving will claim that they aren't, using the same arguments. It won't hold water, but now we're swamped, and the entire thing crumbles. Once again, yes, people who want to justify terrible things can do so. It's not unique to tech bros. Fundamentalist christians, the homeless, and young activists of any alignment can do it too. > ...in part because I know too many of the type of people who get involved and aren't trustworthy. This is the meat; the only question that actually matters: Is it true that EA is disproportionately populated by the "untrustworthy"? If so, then there's a reason to stay away from it. This article's pair of anecdotes are worse than useless for arriving at the answer. All I know after reading it is that the TIMES is interested in taking EA down a peg. The evidence presented is utterly insufficient to support the claim that "EA has a sexual harassment problem [to an unusual--and therefor newsworthy--extent]".
- 8note 4y agoMountains beyond mountains is a great book with an alternative view. Dr Paul is likely to do a good job with your money helping people because he's taking local patients and root causing their problems causing them to get sick, and solving those. Somebody from on high isn't going to have the right perspective to do a good job. I think the effective altruists are solving a problem for themselves "how do I feel better about having all this money" and not "how do I solve this person's lack of ability to fill prescriptions problem"
- gnramires 4y agoI am an EA (in the sense that I believe in the importance of some general principles of the movement, like trying to do the most good, and use data when available -- I don't participate in any organization directly). What I think is the most promising feature of EA is openness to criticism and trying to improve the movement itself. I think SBF was a wake up call and many people in the movement should take note that this isn't how we get to a better future or do the most good (although I think his tactics also were not really EA canon, if there is one, and I don't know if people knew there could be outright fraud -- disclaimer, I don't know the details of SBF's case). That case highlighted the importance of following common sense ethics, honesty and so on. I also think it's a very common issue for smart people to 'get over their heads' (is that a valid expression?), which I wrote about here: https://www.reddit.com/r/slatestarcodex/comments/yww9g6/be_simple_and_transparent_a_heuristic/ https://www.reddit.com/r/slatestarcodex/comments/yww9g6/be_s... It's certainly dangerous to use reasoning to justify whatever you would like to be true. I believe this is addressed in Julia's book 'The Scout Mindset' (haven't read it, only a few reviews!), and it's actually one of the main points of the book (with several examples of that) -- a.k.a. motivated reasoning, arrogance, etc.. We can't be perfect, but we can learn from our mistakes and be aware of those dangers. I hope the EA community will have a sincere look at those issues and address whatever needs to be addressed. I myself will continue to be an EA possibly forever, because the root ideas are very sound. I want to help people, and I want to learn how to best help others. You can't make me not want to help others effectively ;)
- senderista 4y agoWhat’s wrong with fraud if it has positive expected utility? At least if you’re an avowed act utilitarian like SBF.
- deleted 4y ago[deleted]
- kazinator 4y ago[flagged]
- droopyEyelids 4y agoThe point of a scam is that you fall for it due to a moral failing not a lack of aptitude/stupidity. In a scam people use their own intellect to justify chasing after some appetite, so smarter people just convince themselves harder. EA is a scam that uses "the ends justify the means" as the temptation, and that's why people are into it.
- deleted 4y ago[deleted]
- nonethewiser 4y agoIt's OK as an analogy but I don't think actual smart people are more likely to trick themselves.
- Mountain_Skies 4y agoAbout fifteen years ago I got involved with the Skepticism movement. It was great to meet so many seemingly rational people and there was excitement that the movement seemed on the verge of growing large enough to make a paradigm shift in how society acts. But after about a year, I started to really sour on it as I could see more and more things becoming rational by decree and thus beyond question. These were supposed to be skeptics, but they were getting more and more into group think, especially on adopting woo-woo views on medical matters. I had never been a core figure in the local group, so it was easy enough for me to melt away unnoticed but one of my friends was an organizer and regular lecturer. When she finally decided to leave over exhaustion from increasingly abrasive and hostile tone of the group to any dissent, she was harassed for months. The group was seemingly offended that she rejected their brilliance and become an apostate. I think they eventually got subsumed by the Atheism+ movement, which then imploded.
- klenwell 4y agoI have a lot of sympathy for skeptics but this is the first thing that comes to mind the idea of Skepticism as a movement comes up: A few years ago, he told me, he went to a skeptics’ conference in La Coruña, Spain. He was walking down some stairs one afternoon, not long after investigating the statue of a local saint, which was said to protect those who embrace it, when his left leg suddenly crumpled beneath him. “It wasn’t like I fell and broke my leg,” he said. “It was more like I broke my leg and fell.” The other skeptics gathered around as he writhed in agony. When he told them, between gasps, that he thought he had broken his leg, they were dubious. “You know, that might just be a sprain,” one of them suggested. Another told him to try wiggling his toes. It wasn’t until Nickell lifted his leg, revealing that it was bent at a grotesque angle to his foot, that they believed him. https://www.newyorker.com/magazine/2002/12/23/waiting-for-ghosts https://www.newyorker.com/magazine/2002/12/23/waiting-for-gh...
- pyuser583 4y agoThere was an article a while back that the atheism+ movement vanished because it was integrated into the social justice movement. What do you think of that? Is the atheism+ still around? What happened to its people?
- 4y ago
- steveBK123 4y agoaren't these all, at their root, postmodern re-implementations of religion? with all the related problems & benefits.
- NoZebra120vClip 4y agoYes, this is perspicacious. If you reject the premises and practices of religion, you will eventually re-invent them all. Disestablishmentarianism by modern democracies means that without a centralized religion to arbitrate Truth, pseudo-religions will expand their power bases to fill in the blanks. Psychiatry, Social Security, shelters, soup kitchens, hospital and university systems. All were adequately handled by Christendom, until society decided that Christendom was superfluous and hindering their goals.
- steveBK123 4y agoI make this comment as I observe many of my friends attach meaning to politics that people use to attach to religion, and I find it both ironic & troubling as it comes with all the problems of intolerance & lack of compromise, us vs them, etc.
- gverrilla 4y agoWhat a whole bunch of bullshit.
- int_19h 4y ago"God is a dream of good government."
- StanislavPetrov 4y ago>The worst thing about being smart is how easy it is to talk yourself into believing just about anything. After all, you make really good arguments. >EA appeals to exactly that kind of really-smart-person who is perfectly capable of convincing themselves that they're always right about everything. I think that just as big of an issue is that a lot of these EA people are not really smart. They are generally financially successful, which many people confuse with being really smart. This is especially true if that financial success came as a result of being really good at something (like programming), that doesn't necessarily translate into being really good at other things, or being really smart in general. This effect is compounded when other people are constantly stoking their egos due to the aforementioned professional and financial success. This is not to say that wealthy people who go into EA are stupid (they are very likely intelligent) but they just may not be as smart as they believe they are, or as smart as other people tell them they may be.
- throwanem 4y agoThe worst thing about "smart" is that it doesn't mean a damn thing because it conflates cleverness and wisdom, which are orthogonal.
- benj111 4y agoIt isn't about being smart. Anyone can convince themselves of anything, eg flat earthers. >I already know that my money is more effective in the hands of a food bank than giving people food myself In certain situations. Unless you're generally in favour of communism. Most people just skip out the barter entirely and give money, generally in exchange for things. It isn't clear to me why charity in general should be different.
- jtode 4y agoI am out of the loop a bit, so I'll say that first. An acquaintance introduced me to the phrase effective altruism and talked about sending money to a place that's having problems rather than going there yourself, and I just thought, yah, that's a more effective way of being altruistic and went on with my day. I'm just learning that they made it into a cult. Who thought that was a good idea? Just be an effective altruist FFS.
- HDThoreaun 4y ago> I'm just learning that they made it into a cult. EA has a lot of overlap with religion by its very nature. Any moralizing philosophy with dedicated followers will tend to become cultish.
- jtode 4y agoI mean, I agree, but it seems to me that the abstract concept of being altruistic effectively is not moralizing at all - it merely carries the assumption that the actor has taken a moral stance and leaves it at that. I saw it more like "If you are going to attempt to make your actions line up with your morals or ethics as a matter of principle, you should do it in a way that actually produces the result your ethics demand." I mean I'm not really arguing, I know people are gonna do what people do...
- toss1 4y agoYup. Voltaire put it most succinctly: "Those Who Can Make You Believe Absurdities, Can Make You Commit Atrocities" And, as Feynman pointed out: “The first principle is that you must not fool yourself and you are the easiest person to fool.” So, yes, this works just as well recursively, i.e., if you are making yourself believe absurdities...
- HDThoreaun 4y ago> But I don't have any reason to trust them My favorite aspect of EA is the transparency. Givewell and open phil publish white papers that go into excruciating detail about how they reached their conclusions. You don't have to trust them. Read what they publish and make your own conclusions about how to do good most effectively. I've also enjoyed the writing of Julia Galef, especially The Scout Mindset, which many in the EA community have embraced as solutions to not only the "too smart for your own good" problem but general divisiveness/tribalism in society.
- stephenbez 4y agoI’ve looked into EA / GiveWell charity recommendations, but then when I’ve independently looked into IRS Form 990 returns the charities they recommend often seem tiny and have spending of tens of thousands to hundreds of thousands per year. It’s always seemed to me there is likely to be more oversight in larger organizations. I’ve been meaning to ask about this but never had time. Also if you read their recommendations, a lot of times their source is “personal conversations with the leader of the charity”