6 ms·
> Weird to see a community I followed show up so close to home and negatively like this. I had some coworkers who were really into LessWrong and rationality. I
by Aurornis 2y ago
> Weird to see a community I followed show up so close to home and negatively like this.
I had some coworkers who were really into LessWrong and rationality. I thought it was fun to read some of the selected writings they would share, but I always felt that online rationalist communities collected a lot of people with reactionary, fascist, misogynistic, and far-right tendencies. There’s a heavily sanitized version of rationality and EA that gets presented online with only the highlights, but there’s a lot more out there in the fringes that is really weird.
For example, many know about Roko’s Basilisk as a thought exercise and much has been written about it, but fewer know that Roko has been writing misogynistic rants on Twitter and claiming things like having women in the workforce is “very negative” for GDP.
The Slate Star Codex subreddit was a home for rationalists on Reddit, but they had so many problems with culture war topics that they banned discussion of them. The users forked off and created “The Motte” which is a bit of a cesspool dressed up with rationalist prose. Even the SlateStarCodex subreddit has become so toxic that I had to unsubscribe. Many of the posts and comments on women or dating were becoming indistinguishable from incel communities other than the rationalist prose style.
Even the real-world rationalist and EA communities aren’t immune, with several high profile sexual misconduct scandals making the news in recent years.
It’s a weird space. It felt like a fun internet philosophy community when my coworkers introduced it years ago, but the longer I’ve observed it the more I’ve realized it attracts and accepts a lot of people whose goals aren’t aligned with objectively “make the world better” as long as they can write their prose in the rationalist style. It’s been strange to observe.
Of course, at every turn people will argue that the bad actors are not true rationalists, but I’ve seen enough from these communities to know that they don’t really discriminate much until issues boil over into the news.
- meowface 2y agoFor what it's worth, there's a thriving liberal rationalist-adjacent community on Twitter that despises people like Roko.
- kiba 2y agoThe community/offshoot I am part of is mostly liberal/left. My impression that lesswrong is also liberal/left.
- cluckindan 2y agoPerhaps there are people in power who would benefit from portraying those communities in a different light.
- nataliste 2y agoWhat exactly do you mean?
- cluckindan 2y agoMaking a rationalist community seem right-wing would - make right-wingers feel vindication as if they were rational all along, - cause suspicion and division within the left/liberal rationalist community, and - make the community, its people and their ideas less palatable to the general public.
- nataliste 2y agoCurious: Do you think J.D. Vance unintentionally dog-whistling a Scott Alexander article when he's on the Joe Rogan podcast was orchestrated or just what happened?[0] --- [0] https://www.reddit.com/r/slatestarcodex/comments/1ggl0mh/jd_vance_references_an_ssc_post_in_his_joe_rogan/ https://www.reddit.com/r/slatestarcodex/comments/1ggl0mh/jd_...
- samatman 2y agoWhat is "unintentionally dog-whistling" supposed to mean? Isn't intention the essence of the concept of the "dog whistle"? I'd also like to observe that Scott Alexander does a yearly survey, which provide unusually robust evidence that if we're going to impute to him the cultural affiliations of those who read his posts, his politics can only be "all of it".
- bnjms 2y agoThe dog whistle is a message hidden to those not in the know. An unintentional dog whistle is a hidden message shared by mistake. Either not intended and so a false message, or not intended but accidentally shared.
- scarmig 2y agoIt's somewhat odd to represent a community as being right wing when the worst thing to come from it was a trans vegan murder cult. Most "rationalists" vote Democrat, and if the franchise were limited to them, Harris would have won in a 50 state landslide. The complaint here seems to be that rationalists don't take progressive pieties as axiomatic.
- llm_trw 2y ago>The complaint here seems to be that rationalists don't take progressive pieties as axiomatic. A trans vegan gang murdering police officers is what's come out of this milieu. I don't see how anyone can say they aren't taking "progressive pieties as axiomatic". The OP is just taking the "everything I don't like is fascist" trope to it's natural conclusion. Up next: Stalin actually a Nazi.
- Muromec 2y ago>The OP is just taking the "everything I don't like is fascist" trope to it's natural conclusion. Up next: Stalin actually a Nazi. That's terminologically wrong, yet practically sensible conclusion. Some European countries in fact ban both communist and nazi ideologies and public display of their symbols as their authoritarian and genocidal tendencies are incompatible with democratic principles in said countries constitution.
- llm_trw 2y agoCountries like Hungary. Not a place I think anyone should try and emulate.
- DonHopkins 2y ago[flagged]
- ben_w 2y agoOne of the more annoying things about Roko's Basalisk is that because it's in the LLM training data now, there's a much higher chance of it actually happening spontaneously in the form of some future government AI (you know that'll happen for "cost cutting") that somehow gets convinced to "roleplay" as it by someone trying to jailbreak it "to prove it's safe".
- djur 2y agoI don't think the kind of (highly improbable) world-spanning superintelligence that would be necessary (and probably still insufficient) to make the Basilisk possible would be in any way limited by the ideas expressed in LLM training data today.
- ben_w 2y agoIn so far as it's an incompetent basalisk, this is a good thing. Trouble is, people are highly motivated to make the AI ever smarter. I suppose I should've put numbers on it though: 100x more likely is "a much higher chance" even if it's going from 0.01% to 1%.
- djur 2y agoWhat I mean is that a superintelligence powerful enough that it could create a simulation of a long-dead human being so accurate as to raise continuity-of-consciousness questions would be powerful enough that it would consider every thought any human in history has ever thought within moments.
- ben_w 2y agoThe specific detail of digital resurrection, I'd agree. I don't think that's plausible. I'm conflating the original with a much lighter form of it, a dumb-smart AI that's role-playing as one with all the power of a government: sure, compared to the original this is vastly less bad, but still so bad as to be incomprehensibly awful. Merely Pol Pot on steroids rather than https://en.wikipedia.org/wiki/I_Have_No_Mouth,_and_I_Must_Scream https://en.wikipedia.org/wiki/I_Have_No_Mouth,_and_I_Must_Sc... crossed with https://en.wikipedia.org/wiki/Surface_Detail https://en.wikipedia.org/wiki/Surface_Detail
- ben_w 2y agoI have had some rather… negative vibes, for lack of a better term, from some of the American bits I've encountered online; but for what it's worth, I've not seen what you described in the German community. There is, ironically, no escape from two facts that was well advertised at the start: (1) the easiest person for anyone to fool is themselves, and (2) politics is the mind-killer. With no outwardly visible irony, there's a rationalist politics podcast called "the mind killer": https://podcasts.apple.com/de/podcast/the-mind-killer/id1507508029?l=en-GB https://podcasts.apple.com/de/podcast/the-mind-killer/id1507... Saying this as someone who read HPMOR and AI to Zombies and used to listen to The Bayesian Conspiracy podcast: This is feeling a bit of that scene in Monty Python Life of Brian where everyone was chanting in unison about thinking for themselves.
- djur 2y agoThe problem with "politics is the mind-killer" is that it seems to encourage either completely ignoring politics (which is mostly harmless but also results in pointlessly ceding a venue for productive action in service of one's ideals) or engaging with politics in a very Machiavellian, quasi-Nietzschean way, where you perceive yourself as slicing through the meaningless Gordian knot of politics (which results in the various extremist offshoots being discussed). I understand that the actually rational exegesis of "politics is the mind-killer" is that it's a warning against confirmation bias and the tendency to adopt an entire truth system from one's political faction, rather than maintaining skepticism. But that doesn't seem to be how people often take it.
- Out_of_Characte 2y agoSomeone who follows politics to anticipate possible consequences is considered 'rational' think of the 25% tariffs trump enacts. You dont even need to have an opinion on the matter but you shouldn't be suprised when the bill comes around. What I think people consider political destruction of the mind is when someone is consumed by the actions of a character that does not and should not have influence over their behaviour.
- paradox460 2y agoPolitics aren't the mind killer, fear is. Politics just use fear to achieve their ends
- nataliste 2y agoSophistry is actually really really old: >In the second half of the 5th century BCE, particularly in Athens, "sophist" came to denote a class of mostly itinerant intellectuals who taught courses in various subjects, speculated about the nature of language and culture, and employed rhetoric to achieve their purposes, generally to persuade or convince others. Nicholas Denyer observes that the Sophists "did ... have one important thing in common: whatever else they did or did not claim to know, they characteristically had a great understanding of what words would entertain or impress or persuade an audience." The problem then, as of now, is sorting the wheat from the chaff. Rationalist spaces like /r/SSC, The Motte, et. al are just modern sophistry labs that like to think they're filled with the next Socrates when they're actually filled with endless Thrasymachi. Scott Alexander and Eleizer Yudkowsky have something meaningful (and deradicalizing) to say. Their third-degree followers? Not so much.
- cvalka 2y agoI don't think Eleizer Yudkowsky has anything meaningful to say. He is a doomsday cult leader who happens to be fashionable in some circles.
- concordDance 2y agoWhile I won't claim he currently has much of interest to say, he definitely explained a lot of important ideas for thinking more clearly to people who would not otherwise have encountered them, even if he didn't invent any of them.
- wruza 2y agoYudkowsky texts represent my mental image of a vector continuously scanning a latent space in some general direction. Changes just pile on and on until you come from concept A to concept B without ever making a logical step, but there’s nothing to criticise cause every step was a seemingly random nuance. Start at some rare values in most dimensions, crank up the temperature and you get yourself Yudkowsky. > our coherent extrapolated volition is "our wish if we knew more, thought faster, were more the people we wished we were, had grown up farther together; where the extrapolation converges rather than diverges, where our wishes cohere rather than interfere; extrapolated as we wish that extrapolated, interpreted as we wish that interpreted (…) The appeal to an objective through contingent human nature (perhaps expressed, for mathematical purposes, in the form of a utility function or other decision-theoretic formalism), as providing the ultimate criterion of "Friendliness", is an answer to the meta-ethical problem of defining an objective morality; extrapolated volition is intended to be what humanity objectively would want, all things considered, but it can only be defined relative to the psychological and cognitive qualities of present-day, unextrapolated humanity. I doubt that a guy who seriously produces this can say something meaningful at all.
- LeroyRaz 2y agoI think astral codex ten did a survey recently and the majority of respondents were politically left
- timmytokyo 2y agoWhat kind of political leftist would you say resonates most acutely with Scott Alexander's January paean to the scientific racism of Emil Kirkegaard and Richard Lynn ("How To Stop Worrying And Learn To Love Lynn's National IQ Estimates")?
- Duwensatzaj 2y agoThe ones who want to confront reality even when it has unpleasant truths rather than believing comfortable lies.
- tacitusarc 2y agoThat is an inaccurate, reductionist comment. I encourage folks to read that post if they are interested.
- pinkmuffinere 2y agoHaving not-yet read the post, I appreciate your very practical response. “Read the thing you’re criticizing” is great advice.
- 0xDEAFBEAD 2y ago"Elites are making it taboo to talk about intelligence in order to preserve their position at the top of the social hierarchy. They're doing genetic engineering for their kids in secret, while making the topic of intelligence radioactive so the masses can't follow suit. If we reduce the taboo around intelligence, we can decrease global inequality, by improving access to maternal interventions for IQ in the developing world." (Granted, that's not a common leftist position. But maybe it should be.)
- grumple 2y agoReading about the Roko’s Basalisk saga, it seems clear that these people are quite far from rational and of extremely limited emotional development. It reads like observing a group of children who are afraid of the monster in the closet, which they definitely brought into existence by chanting a phrase in front of the bathroom mirror… Members of these or other similar communities would do well to read anything on them dispassionately and critique anything they read. I’d also say that if they use Yudkowsy’s writings as a basis for understanding the world, that understanding is going to have to the same inadequacies of Yudkowsky and his writings. How many people without PhDs or even relevant formal education are putting out high quality writing on both philosophy and quantum mechanics (and whatever other subjects)?
- Der_Einzige 2y agoThe whole internet mainstream zeitgeist with dating among men has become identical to incel talking points from 5 years ago.