20 ms·
I'm having a hard time reconciling all this right now. On the one hand, from the outside, I can see the actions that Facebook takes and they seem awfully guilt
by jedberg 5y ago
I'm having a hard time reconciling all this right now. On the one hand, from the outside, I can see the actions that Facebook takes and they seem awfully guilty of what they are accused of. But on the other hand, I personally know and have previously worked with some of the people who work on trust and safety, specifically for kids. Good people who have kids of their own and who care about protecting people, especially children.
The best I can come up with is that Facebook is so big that the "evil" is an emergent property of all the different things that are happening. It's so big no one can comprehend the big picture of it all, so while the individuals involved have good intentions with what they are working on, the sum total of all employees' intentions ends up broken.
So maybe Zuck is telling the truth here, that they are trying to fix all this. But no one can see the forrest from the trees.
I can't reconcile it any other way.
- rhaksw 5y agoThey're in a tough spot by design. Much of Facebook is private. How can they possibly be transparent enough to satisfy critics about what actions they take? Share too much and another Cambridge Analytica situation pops up. Share too little and researchers decry coverup over lack of access.
- btown 5y agoIf a company desired to be able to sow doubt if its impacts on society ever came under a microscope... one gambit (and an effective one, based on your reaction) would be to hire people who genuinely and passionately research and work on trust and safety, then systematically under-resource their teams and gaslight them into thinking there are fundamental reasons their recommendations must be ignored. For instance, contrast Zuckerberg's statement here: > And if social media were as responsible for polarizing society as some people claim, then why are we seeing polarization increase in the US while it stays flat or declines in many countries with just as heavy use of social media around the world? With such severe under-resourcing and deprioritization that one person had the literal weight of worldwide election integrity on her shoulders, as revealed more than a year ago: https://www.buzzfeednews.com/article/craigsilverman/facebook-ignore-political-manipulation-whistleblower-memo https://www.buzzfeednews.com/article/craigsilverman/facebook... > The memo is a damning account of Facebook’s failures. It’s the story of Facebook abdicating responsibility for malign activities on its platform that could affect the political fate of nations outside the United States or Western Europe. It's also the story of a junior employee wielding extraordinary moderation powers that affected millions of people without any real institutional support, and the personal torment that followed. Haugen echoes the same in https://archive.is/tQwE9 https://archive.is/tQwE9 : > She soon grew skeptical that her team could make an impact, she said. Her team had few resources, she said, and she felt the company put growth and user engagement ahead of what it knew through its own research about its platforms’ ill effects. The fact of the matter is that if Zuckerberg were to say "I'm going to pour our profits into trust and safety and abuse avoidance in order to ensure that our position as a trusted brand is sustainable for generations to come," his high levels of voting control and clear defense to any allegations that this was against long-term shareholder interest would fully make that possible. The fact that quite the opposite has happened should be considered with much more weight than his words in a reactive press statement.
- dannykwells 5y agoThis is called the Banality of Evil. Look up Hannah Arendt. It is a well established idea.
- SeanAppleby 5y agoEichmann in Jerusalem is the book that coined the phrase for anyone passing through, and it's a pretty wild story. It's essentially Arendt, a Jewish exile from Berlin who fled the holocaust, wrestling with her realization that Eichmann, who reported to Hitler and organized major portions of the holocaust, wasn't a psychopath, but a completely mundane and thoughtless career focused bureaucrat who was trying to rise in government and believed in doing what you are told, who then organized one of the most evil acts in human history without reflecting on what he was doing.
- deleted 5y ago[deleted]
- maybelsyrup 5y ago> It is a well established idea. If by "established" you mean that it's well known, then yes, you're right. If instead you mean that it's agreed-upon or widely accepted, you'd be wrong. There's a lot of great debate / critique, both about how well the phrase actually applied to Adolf Eichmann himself (Arendt was famously only at the trial for like 5 days), and whether evil in general is ever, in fact, all that banal. Sadly the conversation around "the banality of evil" hasn't received a fraction of the attention that the phrase itself has.
- bogomipz 5y ago>"Arendt was famously only at the trial for like 5 days..." Besides David Cesarani's "Becoming Eichmann" book from the mid 2000s where he stated Arendt had "only saw Eichmann in action for four days", are there any other references that support this? I've not been able to find any. Also the "in action" in that context specifically refers to Eichmann's testimony not that amount of time Arendt spent in the court room. I'm not sure how "famous" this is. Elsewhere her correspondance with her former teacher Karl Japsers indicates she was there for 10 weeks. That would be about a third of the 8 month trial.
- theshadowknows 5y agoThat’s sort of how things are where I work. The systems are so complicated and the interactions are often algorithmic and machine learning based. We try to maintain documentation and architecture artifacts with as much accuracy as possible. But in some cases things may as well be magic because no one really understands the whole process.
- lovecg 5y agoThe Skynet is here. Who knew it would come for us with outrage causing memes and not metal robots.
- BobbyJo 5y agoI don't think it's an emergent property, I think it's a by-product of the constraints. It's all well and good that they want to make Facebook safe and healthy, and I honestly believe plenty of people working there are trying to do just that. However, they are operating under the constraint that they cannot move backwards on profits, and therefore engagement. Imagine if you were trying to fix climate change, but under the condition that you weren't allowed to burn fewer fossil fuels. You may try very hard, and very sincerely, but it's fool's errand.
- jedberg 5y ago> Imagine if you were trying to fix climate change, but under the condition that you weren't allowed to burn fewer fossil fuels. You may try very hard, and very sincerely, but it's fool's errand. I like this. This helps me. Thanks.
- fortuna86 5y ago> Imagine if you were trying to fix climate change, but under the condition that you weren't allowed to burn fewer fossil fuels. You may try very hard, and very sincerely, but it's fool's errand. This also happens to be the literal policy towards climate change of China. They announced the pause of funds for external coal plants, doubled down on their internal ones.
- TulliusCicero 5y agoA rule more analogous to Facebook's presumed position would be, "you can fix climate change, but you can't do anything that would reduce GDP per capita". Which in practice means that while some useful tools would be on the table, others would definitely not be.
- shkkmo 5y agoNot really since facebook revenue is much more directly tied to engagnement than GDP ia to fossile fuel consumption. To extens the metaphor, Facebook's "alternative energy" is non-advertising based revenue. I see zero efforts from facebook to move away from ad based revenue so there is zero chance that Facebook is going to make meaningful progress in changing.
- ziftface 5y agoDon't you think it's more likely that he's just using these projects to garner some goodwill and sympathy?
- jedberg 5y agoWhat I'm saying is that I know people working on this projects, and they are good people who want to make things better. They wouldn't work on these things if they didn't think it made a difference, as they all have plenty of options on other places to work.
- kelseyfrog 5y agoIt's systems-level thinking applied to people. Reader beware though, once you start down this path, you can become adept at spotting this pattern emerge in many other human systems.
- mbesto 5y ago> I personally know and have previously worked with some of the people who work on trust and safety, specifically for kids. Good people who have kids of their own and who care about protecting people, especially children. Those same people are protecting their children with $300k+ salaries and buying property in area where they can send their children to Gunn HS. While I empathize with these people the direct opportunity to protect your kin should not be understated. Do they mean well? Sure. Are they putting their best effort to fix things? Sure. Here's the most important part: Do you they know deep down inside that the only way to fix these things is to hurt Facebook financially? Probably. But they also know this means risking to protect their own children as a result (forced to move, lose job, less pay, etc.). What would you do? (I think I know the answer) This can't be understated any further - in the end it doesn't matter what individual people at FB think because no one person or group of people has any legal, economical, or logistical ability to control the company except Mark Zuckerberg. He is figuratively and literally impossible to fight. Well, unless everyone deleted their accounts.
- vineyardmike 5y ago> Do you they know deep down inside that the only way to fix these things is to hurt Facebook financially? Probably. The crazy thing is that FB has taken steps to improve things in past that also hurt them financially (eg post cambridge analytica) . They just make so much money and so fast that its like 1 or 2 bad quarters and its over. So (1) mark being all powerful means he alone can decide its worth lower profits - he's done it before. (2) The loss of profits probably wouldn't even matter.
- sorry_outta_gas 5y agoWithout all the bullshit facebook is just AOL messanger and a group calandar, they need it people need to interact with facebook non-stop for it to remain relavant
- ashtonkem 5y agoI also wonder how many of them forbid their children from using Facebook’s products.
- zestyping 5y agoThis is exactly the point Frances Haugen is making, and it's why this is so different and so much more significant than the other Facebook scandals and leaks in the past. Haugen repeated over and over again her testimony today that Facebook is full of smart, thoughtful, kind, well-intentioned people, and that she has great empathy for them, even Mark Zuckerberg. Her point is that they have created a system of incentives that are inexorably leading to harmful outcomes. It is not about good and evil people, it is about the incentives. It's exactly as you are saying. That's why she is not advocating to punish Facebook for being evil, but rather to force Facebook to reveal and permit research so we can understand the system and fix it, because Facebook is too deeply trapped in its own tangle of incentives to fix itself. In this I think she is absolutely correct.
- angelzen 5y ago"Facebook has created a system of incentives that are inexorably leading to harmful outcomes" Exactly right. The solution baffles me. "Force Facebook to reveal and permit research so we understand the system and fix it" Basically keep the harmful system in place, but pass the reins to an unspecified cabal hiding under the innocuous word "we". Hard pass.
- astronautjones 5y agoend algorithmic recommendations
- ramraj07 5y agoIt’s like saying that the people working in the slaughter houses are actually kind folk who do like animals and care deeply for their well being. That can be absolutely true, but they still work for a slaughter house. Your care and trust doesn’t matter a bit because the fundamental nature of the organization is that it profits from cruelty. I understand it pays well, and that maybe they are trying to be nice and all, but yeah there’s only so much purity of heart you can insist while still working for the slaughter house that is Facebook.
- atonse 5y agoI actually think this analogy is the very opposite of what you may be trying to explain. A lot of people that work at slaughterhouses do so because they have no other choice. It is the best opportunity that's afforded to them. It is a job that causes trauma for many, often has long, grueling hours, and doesn't pay well. Working at Facebook couldn't be further from that situation. Never mind the obvious perks (the tech, the white collar work, the gourmet food, I hear there's also a wood shop where you can go do woodworking on your break, the half a million dollar salary, etc etc etc). But the overwhelming majority of these people have the whole world of job opportunities to choose from, if they're willing to take a pay cut from an INSANELY HIGH salary to just a VERY HIGH salary. So in that sense, they couldn't be further away from working at a slaughterhouse. The fact is, they could quite literally work anywhere else (any other company or any other city/country with remote work now), and they choose not to. It's not desperation but the textbook case of golden handcuffs. It's very, very difficult to say no to 500k a year. I'm not even sure I could say no if I were in that position. I'd probably tell myself "Just coast for two more years and both my kids won't have to pay for college" or something like that, and keep going.
- opportune 5y agoI have said no to a Facebook offer before (I actually recommend everybody apply to Facebook, they give great offers you can use for negotiation elsewhere and it wastes their time). Like you said, we’re talking about the differences between insanely and very high here. I don’t think a 20% increase in TC is worth making the world a worse place, and I’d hope for most people that’s not a hard decision.
- dogman144 5y agoGood people have gone to work at facebook (and google) on jobs like privacy engineering and really try to do good work. however, no matter how capable and ethically sound they are, the incentives are forever misaligned with the profit models for both, and adtech over all, as it currently stands. truly good people can chase money and hope to do good things in the process. it's as easy as this. the writing was on the wall when alex stamos, by all measures the best example of the type of person you're referring to and FB's chief security officer... left. started in 2015 and was out of there by 2018. not many c-levels walk away from a job like that for the reasons he did, and when they do that should be the even to pay attention to (looking at you, sheryl "lean in" sandberg). this was the marker event if people were looking.
- wpietri 5y agoThe person who mentions the banality of evil, dannykwells, has an excellent point. But there's more at play here. I briefly worked on Twitter's anti-abuse engineering. Many of the people on that team cared a lot about protecting people. I sure did. But we didn't have the necessary power to actually solve the problem. The people who did have that power were senior execs. They might say that they cared. In their heart of hearts, perhaps they even did. But their behavior demonstrated that they cared about other things much more. My boss's boss, for example, was an engineering leader who had a climber's resume: quickly advancing through positions of more and more power. In my view, he cared about that a great deal, and did not give a shit about the actual harm to users. As soon as he got the chance, he pushed out my boss, laid off the team's managers, me included, and scattered the people to the wind. I presume the same was true about the senior execs. They were aware Twitter was causing harm to people. If they wanted to know the details, we had plenty of research and they could have ordered more. Did they care? Impossible to know. But what they focused on was growth and revenue. Abuse was a big deal internally only as long as it was a big deal in the press.
- spoonjim 5y agoThis is a place where the founder-CEO-demigod like Zuck should able to make better decisions than a professional team like Twitter. The long term profit maximization strategy was to maximize profits only up to the point where you risk getting regulated by government. With all the fawning praise of him as a kid I don’t think Zuck envisioned that one day both Democrats and Republicans would be united in their desire to fuck him over.
- zeruch 5y ago"The long term profit maximization strategy was to maximize profits only up to the point where you risk getting regulated by government." That is correct, but as with Wall ST, the addiction to the gamble has long been unhinged by an environment that has been lax on regulatory options...so when the blowback actually hits, it will not be just painful it will likely come on the tail end of a ragnarok-grade event that will likely shank the whole industry for a generation because current C-suites are so far up their own asses they can take direct inventory of the last few days of meal plans.
- kumarvvr 5y agoFB seems guilty, only because their internal findings were leaked. I have no empathy for them. They bring out the worst in Humanity. They build walled silos of festering hate and anger, all driven by "user engagement", "hours on site" and money.
- deleted 5y ago[deleted]
- ta1234567890 5y ago> So maybe Zuck is telling the truth here, that they are trying to fix all this. Maybe they are trying, but also maybe they are trying to have their cake and eat it too. What I mean is that very likely the proper way to fix things would financially hurt FB, which seems it’s something they really don’t want to do.
- 2pEXgD0fZ5cF 5y ago> So maybe Zuck is telling the truth here, that they are trying to fix all this. Except they are just playing around with the outrage algorithms, the problem is created by Facebook, not some natural occurence. If they wanted to "fix" anything they would make their algorithmic timelines opt-in, or at least an option, for starters. It is of course very much in the interest of the people working at Facebook to make this seem like a problem that is just there and that it is some "difficult to solve", that "moderation doesn't scale" etc.. These are deflections to make everyone ignore that Facebooks tampering is where it starts.
- worrycue 5y agoI wonder how Facebook’s algorithm works. I know YouTube’s just recommends based on what you just watched/search (you can disable this aspect by clearing or disabling your histories), channels you have subscribed to, (I believe) videos you have “Like” or commented on, and videos you have marked as “Not interested -> I do not like this video”. Is Facebook’s as “viewer driven”? Or does it recommend based other criteria? e.g. like what’s generally popular.
- opportune 5y agoThis, their entire premise of modifying their engagement-optimization to try to account for wellbeing but still optimize engagement is flawed. It’s clear that outrage and anger drive engagement over all else. If they want to fix things they can just bring back chronological feeds; but they won’t because the incentives are just too misaligned.
- coffeefirst 5y agoConveniently, everyone knows this except the people who stand to lose a lot of money by saying it out loud.
- throwaway09223 5y agoI've been framing this whole thing as a universal property of human society and it seems to fit pretty well for me. Outrage attracts attention in all group interactions. I can't think of a single large scale group forum where this isn't true. It's integral to an absurd degree in our news cycle. Howard Stern exploited this property in his rise to fame. It's a core element in state propaganda, well documented throughout human history. I'm old enough to remember when the internet was a lot more free - when there generally wasn't some parent corporation imposing content censorship on what you put on your homepage, or what you said on IRC. All of the complaints regarding Facebook were true of internet communications back then too (on the "sex trafficking" issue, compare to Craigslist of yore!) The big difference seems to be there's an entity we can point a finger at now. Communications on Facebook aren't worse than what was on the internet two decades ago. In fact, they're far, far more clean and controlled. What I look to is whether Facebook is more objectionable than alternative forms of communication, and I can't find any reason to believe that this is the case. Is twitter better? Is reddit? Is usenet? No. So why does Facebook draw such ire? Are people calling for controls on Facebook also calling for controls on self-published websites? On open communication systems like IRC or email? Where is the coherent moral philosophy regarding internet speech? To be honest, my biggest concern when I read the news surrounding this issue is that most of the internet might not be old enough to remember what it means to have a truly free platform, unencumbered by moralizing. Why are people begging for more controls?
- Karrot_Kream 5y agoI think a lot of folks forget that Facebook wanted to come in and clean up some of the filth in social media. They felt that by attaching your _real_ name to your posts, instead of a handle as was the traditional practice, that you would have something to lose (social standing, esteem, etc) and so you would be more thoughtful about your actions. The contrasts at the time were reddit, SomethingAwful, and 4chan. There was _definitely_ extant toxicity on the internet and there were funny posts in the early days of GMail that you could stop them from displaying ads by inserting lots of expletives and bad words in your email (and so some would have GMail signatures that just lumped bad words in together and explained it as an ad circumvention thing). But I think there are a few key innovations that make FB worse for human psychology than previous iterations. Chief among them is the algorithmic newsfeed designed to drive engagement. Outrage certainly provokes responses, but in a chronological feed situation, eventually threads would become so large that the original outrageous situation would be pushed far back and the outrage would go away. Algorithmic newsfeeds bubble these to the top and continue to show them as they get more comments/retweets/shares/etc. They reward engagement in a visceral way that offers perverse incentives. Secondly is the filter bubble. By showing you content hyper-relevant to your search interests, you can easily fall into echo chambers of outrage and extremism. Internet communities, like IRC channels, had huge discoverability issues. Each community also usually had disparate ways to join them adding another layer of friction. Even if you were an extremist it took dedicated searching to find a community that would tolerate your extremism. Now mainstream platforms will lump you into filter bubbles with other people that are willing to engage and amplify your extremist posts. Combine horribly narrow echo chambers with engagement-oriented metrics and you'll have a simple tool for radicalization. That way when you're thinking of committing a violent act because of the disenfranchisement you feel in your life and your community, you'll be funneled to communicate with others who feel similarly and enter a game of broad brinkmanship that can quickly drive a group to the extreme. Balkanization and radicalization.
- LordHumungous 5y agoAll I can suggest is look at the actual data and not the reporting on the data.
- wespiser_2018 5y agoNot all evil looks that way to outside observers, unfortunately. I believe that the assumptions of FB that allowed it to get so big, "optimize engagement above all else", built a system that in many ways is at odds with the values of our society when everyone is a user. Internally at FB, everything looks good, you hit all your OKRs and believe users are better off. Maybe you don't, but you're bonus is huge so you'll put your head down and keep on. Externally, it's an entirely different picture. Connecting people is a comically small issue society needs FB to solve, relative to our need for them not to harm children, or promote extremism, or hide research when testifying to congress.
- wpietri 5y ago> So maybe Zuck is telling the truth here, that they are trying to fix all this. But no one can see the forest from the trees. Ah, this is what I think of as Schrodinger's Accountability. Zuckerberg and Facebook's senior execs are simultaneously: A) so brilliant for running Facebook that they deserve to be incredibly rich, and B) so normal that they can't possibly be expected to understand the consequences of their actions, and so are morally blameless. Heads they win, tails we lose. I say it's one or the other. If Facebook is too big to be understood, it should be broken up into small enough units that mere mortals can see the forest and tend it responsibly. And if not, the execs should be morally and legally culpable for the harm it does.
- johnsimer 5y agoNow adding “Schrodinger’s Accountability” to my list of mental models
- burnished 5y agoYou may be missing the point if you think your point is orthogonal to theirs. Mark Zuckerberg doesn't have to be painted as a reptiloid in order for his actions to be bad, or for those actions to cause harm. More than blaming shit needs to get fixed right? We can still hold people culpable, but we don't need to do that, don't need to indict anyone before trying to fix a problem that is self perpetuating due to individual incentives and a complete lack of oversight.
- deleted 5y ago[deleted]
- wpietri 5y agoThe senior execs are the ones who set up the incentive systems there. They are the ones who are richly paid to provide oversight. So either this is exactly what they want or they're hopelessly incompetent. And yes, I think we should change the incentives. We should change them such that executives face direct personal punishment for negligent or intentional harm. We should have learned that lesson during the 2008 financial crisis, but instead nobody did time. The worst that happened was that some very rich people were forced to give back a modest percentage of their gains.
- noobermin 5y agoSo if it a form of a modified Hanlon's razor, "never attribute to malice what can be explained by lack of capability" particularly because they are too big, it sounds like the answer is to break them up so they aren't too big. Is that the solution?
- YossarianFrPrez 5y agoZuckerberg is making an almost entirely emotional appeal in his statement. Most of his claims are not backed up / buttressed with facts, numbers, and specifics. The statement is designed to make a reader feel bad for Facebook as if Facebook was a friend, and not a corporation with billions of dollars in quarterly profits. Though the statement seems well-meaning, etc., it is weaselly and manipulative. It also conveniently doesn't address some of deeper issues from Frances Haugen's testimony. For example, Haugen focused on the fact that Zuckerberg has created a relatively flat organization, where if decisions help the core metric they must be good, and vice versa. Haugen testified that Zuckerberg was made aware that instituting a newsfeed tweak would entail a) small ding to the core engagement metrics and b) would decrease violence in Ethiopia... He chose the metric over the decreased violence. There comes a point where blindly pursuing metrics -- be it money or engagement -- without regard to the effects on society are hard if not impossible to distinguish from sociopathic behavior. Also, let's not forget that researchers and renown statisticians employed by / sponsored by Big Tobacco (e.g. R.A. Fisher) convinced themselves that smoking didn't cause cancer. [0] [0] https://pubmed.ncbi.nlm.nih.gov/2000852/ https://pubmed.ncbi.nlm.nih.gov/2000852/
- garbagecoder 5y agoRoger McNamee warned us.
- senojretep356 5y ago"Ethiopia violence: Facebook to blame, says runner Gebrselassie" This is the headline from BBC in 2019. It makes me so angry and upset. If facebook was run ethically how much smaller would it really be? 10%? 20%? I can't help think that although they would lose some customers they would also gain others.
- native_samples 5y agoHow so? He asserted several apparently factual claims that would basically undermine or make irrelevant most of the commentary in this thread, for example: - Social media can't cause "polarization" because the measurements of that are going down in most of the world, except the USA. But social media is heavily used everywhere. - It makes no sense to claim an organization doesn't care about X when it heavily funds research into X. - If you react to a company researching the harms of its products by leaking everything and publicly accusing the company of being evil, other companies will simply not do research into the harms of its own products. The second two are just logic. The first would benefit from a citation but I'll take his word for it.
- deleted 5y ago[deleted]
- istorical 5y agoSeems like you more than anyone would see that solving the types of problems FB is trying to solve eg: freedom of speech vs user safety / harm reduction is not some super simple problem, no? I wouldn't call Reddit evil despite the fact that many powermods are both amazing contributors doing free labor and curating great communities while also simultaneously abusing their power every day to silence people they disagree with, shaping narratives in human culture, automating blanket unappealable bans on users for participating in unrelated subreddits (even if you were participating in that subreddit in order to combat its views), making snap judgments on content moderation that might ruin someone's day when they make a bad call on a ban or delete, or unilaterally self appointing themselves as mouthpieces for their broader communities via subreddit blackouts or preachy pinned posts. It's unfortunate that when you build a product so close to the ground of human communication and human nature you're never going to be able to get everything right, and you're no longer solving technology problems alone but trying to basically combat basic human moral failing itself. We don't ask that of the telephone company. ^ That being said, we can only excuse some of their failures with the above line of thinking. Others we can blame on greed or recklessness, or ignoring the social costs of something like ML recommenders optimizing for engagement. Not sure if those things deserve to be called evil, but I'd still hold back personally. Misguided, overcome by greed, or reckless, perhaps.
- burnished 5y agoPoint of order: the issue with Facebook is the various engagement algorithms that they are and have been perfecting. This is unlike anything humans have ever seen before. We are no longer anywhere near to 'the ground'.
- rumblerock 5y agoYeah, there is a big difference between Reddit and Facebook in the above comparison. All the examples of issues with Reddit can more or less be attributed to specific people and fall more in line with "bad" human behavior. Facebook's algorithm is something entirely different in it's design - it's primary objective is to manipulate the behavior of the user on the other side, and what it chooses to show or not show doesn't follow any human line of reasoning outside of some loose built in "safeguards" and unenviable content moderators meant to serve as the guardrails.
- boringg 5y agoThe complexity of the system is too great. It’s similar to how the economy runs, there are many very intentioned, intelligent (event brilliant) people who study and focus on it. The problem is it is so complex that no one can fully understand all the components. Not to mention the amount of people in Facebook and in the economy who are intentional bad actors. I’m not saying they are blameless I just always have a tough time laying all the blame on a couple people.
- davesque 5y agoShouldn't it then be possible to account for and correct for the emergent evil? That's the point of government regulation is it not? Maybe then an appropriate, self-critical response from Facebook would be, "Yeah, our system is broken. How can we help?" instead of immediately going on the defensive. If they claim to care about the bigger picture, they need to acknowledge it without excuses.
- Karrot_Kream 5y agoI mean, that's what it might be. This might be the "banality of evil", an emergent property of social networks themselves. If this is the case then we have a harder question ahead of us as an entire world: how do we fix the problems of pandora's box?
- Forge36 5y agoI can care about many things. Eating healthy, getting exercise, reading. My actions can show otherwise. IE: im going to go eat a slice of cake, sit down and watch TV tonight. My priorities and actions don't appear to be inline and the result I'm going for won't be met.
- spoonjim 5y agoThe disconnect is that Facebook is coming at this with the assumption that it is right and proper for Facebook to exist. The rest of us don’t make that assumption. So “how can Facebook best serve kids” might be “withdraw from routing tables permanently” but that isn’t on the whiteboard in Zuck’s office.
- Soaae 5y agoIts easy to reconcile. Just remember Rationality is Bounded, ie there are problems chimps with 6 inch brains cant solve. Its the classic Jurassic Park story, where man says he can control anything. And then realizes he cant. By which time its too late. This is why the road to hell is paved by "good people who have kids" with their good intentions. FBs issues did not appear yday. Like the endless war the issues where there right from the start. So why are we talking about it today? Cuz lots of good people didnt do anything, not because they arent good or skilled, because the problem is too complex for them. This is where Bounded Rationality helps resolve issues. If the problem is too complex, pick a simpler problem. This is hard for some chimps to do for various reason. So entertaining them is a recipe for disaster. Their narrative will always be- "people are good. People experienced World War 1. They know whats at stake. They lost family, friends, body parts. Many are great Heroes. Trust them. They know what they are doing". And still we got World War 2. Why? Cause rationality, skill and experince doesnt matter for some problems. All the "good germans" from politicians, to religious leaders, to military and intelligence leaders knew Hitler had to go long before any notion of war entered the minds. Every coup and assassination they ploted they second guessed themselves. All of them ended up dead.
- vineyardmike 5y ago> The best I can come up with is that Facebook is so big that the "evil" is an emergent property of all the different things that are happening > so while the individuals involved have good intentions with what they are working on, the sum total of all employees' intentions ends up broken. I think, honestly, that a huge thing is that when you put together basically the entirety of the internet, and society into a giant conversational feedback loop you're bound to spin out the worst, especially if FB wasn't 100% of the time trying to filter it (which they weren't because its a business and the problems weren't always equally known).
- shrimpx 5y agoWhat I hear from Zuckerberg over and over is "we're good people and working on it, look at A and B things we're doing" with an implication that that's good enough, so what's everybody up in arms about? That's the core of his tone-deafness to me. If Zuckerberg is fully honest, it means he basically just doesn't have a grip on reality and he isn't fit to lead a corporation this big and impactful. And I tend to believe that, because he's ultimately just a college kid with a laptop who ended up in some circumstances that snowballed.
- reducesuffering 5y ago> ultimately just a college kid with a laptop who ended up in some circumstances that snowballed When will this “just luck” characterization of Zuck die? His entire company was certain they should sell for $1B, and most executives resigned when he didn’t. He maneuvered control of the majority of voting shares, how many other founders have done that? Instagram and WhatsApp were genius acquisitions everybody at the time clamored were too overpriced. Even Oculus has turned out to be the leading VR platform. All of the people close to him attest to his extreme intelligence. Whether malicious or not, Zuck didn’t just “aw shucks I got lucky” into the majority owner of a $1T company, cmon…
- Xeronate 5y agoIt will never end because people have the inherent desire to tear down those they don't like.
- shrimpx 5y agoNah, he's really smart, but implying 1T is a measure of his genius is ridiculous. Not only does it downplay the massive contributions of hundreds of people including Peter Thiel and Cheryl Sandberg, but it ignores the market conditions that led to thefacebook.com going viral, not to mention the Winklevosses, who got paid billions in today's valuation. Do you believe that if Zuck never met the Winklevosses, he would have necessarily built a 1T company anyway, because quantity X of genius must necessarily manifest to F(X) valuation? I think the market violently disagrees with you.
- xtracto 5y agoAs other have said, my experience with Facebook just doesn't mirror the "angryness" and hatred that other people are seeing. My Facebook stream is just every day things from friends I have made through the world. It is very useful for me to maintain a bit of a touch with people I esteem so much but with whom I've list touch through the years. The "angry facebook" experience to me seems like the moms against heavy metal / twisted sister case: People are seeing a reflection of what their peers share. If their circles are angry and share disinformation, that's what they will see.
- LudvigVanHassen 5y agoThis is true too. And the majority of Facebook users I know unfollow people who post political topics. It is about the circles.
- vt240 5y agoI've also never had an issue with Facebook. I've been online through usenet/irc, AIM, livejournal, and then forced to join Facebook because everyone at the university was using it for class correspondence. Later, I have exactly your sentiments, that it has allowed me to stay in touch with people I would have lost touch with over the years. I take advantage of some of the groups for my industry, and my hobbies. I use our company's Page to interact with a whole segment of our international customer base, that would never think to call our support telephone number or e-mail. It's never been a negative experience for me. Although I only look at it when I get home from work at night on my desktop computer. And don't ride around all day with the app running in my pocket. I don't quite know if that would make a huge difference though.
- zeruch 5y ago"The best I can come up with is that Facebook is so big that the "evil" is an emergent property of all the different things that are happening." I half agree. I do in fact think its ben baked in from the get go, just that there was a period where it was not an obvious pillar; you could in fct do all kinds of essentially innocuous things and accept some surveillance capitalism with awareness of your wn liabilities. It's now become so much larger and problematic, that the 'emergent property' is that every move adds weight to the need for the firms dismemberment into smaller units, or punishing regulatory limits. And I mean truly brutally, snap-noise making bone-breaking regulations. "So maybe Zuck is telling the truth here, that they are trying to fix all this." Nope. He knows if he wants to stay on top, he had t keep doing mpre of what hes done, and that his choices are otherwise to actually adapt, which he will not do.
- Waterluvian 5y agoI don’t think the existence of good people or what any one’s intentions are matter at all. I doubt anyone can change the course or Facebook. The stock price runs the show.
- bostonsre 5y agoCouldn't it be possible that the people you know try hard but are limited with what they can do because of policy and decisions that come from above? Stuff like hiding research that looks bad isn't something that a dev or even a manager decides.
- devwastaken 5y agoThe human element is not a variable we define in code. There are things that, by the nature of how they're used, become harmful. Intent does not matter. Good people can intend that their new free anonymous file sharing service will be amazing. Until it's used by bad actors. The concept is good, the intent is good, but in practice it doesn't work that way. There's also another concept, the reality that people do not actually care as much as we think they do. There's a program every public school in the U.S. has where kids run at each other, at speed, knock each other to the ground with concussions, tear their muscles, break their bones, and have terrible behaviors towards one another. Yet every school still has said program. Parents encourage their kids to join. We just don't care about whats right.
- baby 5y ago> The human element is not a variable we define in code. There are things that, by the nature of how they're used, become harmful Agree, but I think we should look at guns first then. Invented to kill, and yet we let people mass buy them for fun
- titzer 5y agoSometimes it is not the virtue of people in the organization, it is a function of the structure and incentives of the organization, the "emergent property" that you reference. Imagine if a company had invented methamphetamine, but the ill effects weren't as readily apparent. Then they built an empire on the belief that the societal benefits of millions of people running around in a seemingly ultra-productive manic state were a godsend to society, and that they had truly changed the world. Then realize that the effects of Facebook are worse than that--it has the opposite effect on productivity, has maybe worse mental health effects, and is nevertheless highly addictive. The reality would never sink in inside that bubble. Worse, the tens of thousands of people whose jobs and wealth depending on tuning said meth to be as addictive as possible are...what? Pawns? Believers? Accomplices? Delusional? Regular people. They are regular people.
- paul7986 5y agoIt's ridiculous to think a platform that most of humanity uses can be controlled to the liking of the left, the right, the upside down and etc ... cause all those groups make up humanity and we all do not nor will ever think exactly the same and we all have different motives and biases. Misinformation that's been around forever... ever play the telephone game in school .. you tell one person a story they tell the next and the next and the next soon that story is no longer factual. Stir all that in with bias and things get even murkier!
- mzs 5y agoThere is only one way to fix this, prevent anyone from influencing what is shown more prominently to users. The simplest solution for that would be simply chronological order only from your friends.
- mzs 5y agoIt took me about an hour of clicking but I seem to have a FB feed that is just my friends in chronological order again: https://www.facebook.com/?sk=h_chr https://www.facebook.com/?sk=h_chr I had to go into my groups settings and unfollow them all individually though: https://www.facebook.com/groups/feed/ https://www.facebook.com/groups/feed/ Same for pages: https://www.facebook.com/pages/?category=liked&ref=bookmarks https://www.facebook.com/pages/?category=liked&ref=bookmarks
- 1vuio0pswjnm7 5y agoAnother "statement", one not intended for the public https://www.buzzfeednews.com/article/ryanmac/growth-at-any-cost-top-facebook-executive-defended-data https://www.buzzfeednews.com/article/ryanmac/growth-at-any-c... (Note: "Connecting people" here does not mean providing communications services, it means using behind-the-scenes, unconsented, and sometimes deceptive tactics to figure out whether and how people are connected to each other IRL.) Andrew Bosworth June 18, 2016 The Ugly We talk about the good and the bad of our work often. I want to talk about the ugly. We connect people. That can be good if they make it positive. Maybe someone finds love. Maybe it even saves the life of someone on the brink of suicide. So we connect more people That can be bad if they make it negative. Maybe it costs a life by exposing someone to bullies. Maybe someone dies in a terrorist attack coordinated on our tools. And still we connect people. The ugly truth is that we believe in connecting people so deeply that anything that allows us to connect more people more often is de facto good. It is perhaps the only area where the metrics do tell the true story as far as we are concerned. That isn't something we are doing for ourselves. Or for our stock price (ha!). It is literally just what we do. We connect people. Period. That's why all the work we do in growth is justified. All the questionable contact importing practices. All the subtle language that helps people stay searchable by friends. All of the work we do to bring more communication in. The work we will likely have to do in China some day. All of it. The natural state of the world is not connected. It is not unified. It is fragmented by borders, languages, and increasingly by different products. The best products don't win. The ones everyone use win. I know a lot of people don't want to hear this. Most of us have the luxury of working in the warm glow of building products consumers love. But make no mistake, growth tactics are how we got here. If you joined the company because it is doing great work, that's why we get to do that great work. We do have great products but we still wouldn't be half our size without pushing the envelope on growth. Nothing makes Facebook as valuable as having your friends on it, and no product decisions have gotten as many friends on as the ones made in growth. Not photo tagging. Not news feed. Not messenger. Nothing. In almost all of our work, we have to answer hard questions about what we believe. We have to justify the metrics and make sure they aren't losing out on a bigger picture. But connecting people. That's our imperative. Because that's what we do. We connect people.
- inciampati 5y ago
- someonehere 5y agoI have a friend who started work there in the last three years. It’s so big and so organized, they can come up with an idea for a new service or policy they want to implement and it takes roughly two weeks to get all the channels to approve and move forward on the idea. Implementation is different, this is just getting all the approvals from legal, finance, marketing, etc.. They are definitely in a position to make changes quickly should they need to.
- hzay 5y agoI worked at FB and struggle with exactly this.
- megablast 5y agoGood people work for oil companies and car companies.
- fulafel 5y agoAt this point of the climate disaster those are getting very rare especially in oul. Maybe those, if they exist, who are working hardest at stopping most oil production and enacting cap and trade.
- IncRnd 5y ago> So maybe Zuck is telling the truth here, that they are trying to fix all this. But no one can see the forrest from the trees. Don't fall for words! Frances Haugen was able to see the big picture. The documents she presented had Facebook employees mentioning it. Facebook didn't act on what was known. It is not that it wasn't known. To paraphrase John Roberts - the only way not to do a thing is not to do that thing.
- x0x0 5y agoThe statement that made it really clear to me was facebook has moderators for 50 languages... while supporting 111 different languages [1]. It's wildly irresponsible to offer services in a language you can't moderate in. And it's sure seems an intentional part of their fig leaf denial strategy -- viz the recent revelations about human trafficking on fb in arabic [2]. Or armed groups in Ethiopia inciting violence on FB in ways that fb chooses not to monitor because of language issues [2]. A company with 21Q2 revenues of $28.5B can't hire moderators in languages spoken in countries with low costs of living... It reflects a thirst for growth with no thought given to the people affected by their growth. [1] https://www.reuters.com/article/us-facebook-languages-insight/facebooks-flood-of-languages-leaves-it-struggling-to-monitor-content-idUSKCN1RZ0DW https://www.reuters.com/article/us-facebook-languages-insigh... [2] https://www.wsj.com/articles/facebook-drug-cartels-human-traffickers-response-is-weak-documents-11631812953 https://www.wsj.com/articles/facebook-drug-cartels-human-tra...
- xg15 5y agoThere is a German saying: "Der Fisch stinkt von Kopf her". 90% of all employees may very well have the best intentions, but this doesn't mean anything if the decision makers have not. A company is not a democracy. Indeed, we have probably just seen one of the (former) employees with good intentions struggle to stay true to them.
- deleted 5y ago[deleted]
- jmfldn 5y agoIts been said that this psychopathic behaviour is an emergent property of many corporations and emerges due to the nature of their very legal structure. In other word, the people may be fine but the outcomes can turn out not to be. See... https://en.wikipedia.org/wiki/The_Corporation_%282003_film%29?wprov=sfla1 https://en.wikipedia.org/wiki/The_Corporation_%282003_film%2... "The Corporation attempts to compare the way corporations are systematically compelled to behave with what it claims are the DSM-IV's symptoms of psychopathy, e.g., the callous disregard for the feelings of other people, the incapacity to maintain human relationships, the reckless disregard for the safety of others, the deceitfulness (continual lying to deceive for profit), the incapacity to experience guilt, and the failure to conform to social norms and respect the law"
- hansel_der 5y ago> So maybe Zuck is telling the truth here, that they are trying to fix all this. But no one can see the forrest from the trees yea, maybe.. they _are_ cashing in billions in the meanwhile
- hansel_der 5y agoi want to downvote you so badly
- hellbannedguy 5y agoWe have all seen Zuckerburg testify in front of Congress/Senate. The guy is a calculated lier. The politicians don't have a clue to what he says, but we know the show he's putting on. I know the guy through that movie, and he just seems like a terrible petty person that has tied every bit of his self worth into making money. In a way it's sad. He just strikes me as a very unethical person.
- Applejinx 5y agoI'm reminded of Terry Pratchett's image of the row of mugs (with cute little sayings) owned by the torturers of Omnia's Quisition. This is a generally hard problem but it's as significant now as it was in the aftermath of WWII. I'd say it speaks to the reality of human subjectivity, and it never goes away: I can only wonder if the same will be true of AI, and whether it's possible for a thinking being to really internalize the concept of hard limits to their perception, and build that into their model of the world. You could say the God concept is a way of trying to internalize the limits to perception: 'something is vastly significant and it's not me, and my understanding does not and cannot encompass it'. With OR without this concept we as humans are exactly as evil as each other. That's the secret. There isn't a qualitative difference between 'us' and history's great monsters. It's about the choices we've made and how we've acted on them: the rest is rationalization, which we are all subject to in one way or another. Grappling with this is the Nuremberg moment: the question is 'never mind whether you feel you've been good, what have you done?' So, what have they done?
- emerged 5y agoIt’s easy for me to reconcile after living through COVID. There are people in my own family who have emotionally told me they’d never do anything to hurt their family. Meanwhile throughout the pandemic they have purposefully hidden when they have been sick and spent full days with their elderly family and immune compromised 3 year old, touching food and participating in cooking. There is a big difference between emotional and cognitive empathy. I also think the people who make the biggest show of how much they care tend to be the same who don’t actually act in a caring way at all. No, I’m not surprised at all that FB employees say they really care. And that they do so very convincingly.
- ralfn 5y agoThe problem with facebook is that it plays with fire every day. Kills innocent people every day. But they have a fire department, so they can't be all bad right? If you can't do what you do in a way that isn't this harmful to the world, then you always have the choice to just stop it. These are all smart people. They could be working on anything else and be successful at it. But they are scared of change. The money is too good. I just wish the people working at facebook that are decent, that they would just leave and go work somewhere else. And that we stop debating whether Zuckerberg is redeemable. He is not. He is a psycho. He is why it escalates this much. He is a monster. Beyond all the lies, he intends the damage he does to the world. Maybe someone bullied him as a child. Maybe he is just not well. I don't know.
- amelius 5y agoPerhaps we should help Zuck a little, and ban advertising in any social media application. That should at least set the incentives straight.
- stevespang 5y agoCLASSIC Zuck. You have to be logged in to his pathological death star of a franken-site to even read his response to the whistleblower. No doubt some kind soul will copy and paste it on another site (and post the link) for all those who REFUSE to ever become a faceplant member. Oh, but beware, Zuck will come hunt you down for re-posting HIS copyrighted property on another site - - after all, even his response gathers eyeballs and information-data he can sell about YOU. More interesting reading about the scandal can be found here: https://www.theverge.com/2021/10/5/22711182/facebook-whistleblower-smear-pr-response https://www.theverge.com/2021/10/5/22711182/facebook-whistle...
- darkmarmot 5y agoSo, anecdotally, the most amoral programmers that I've ever worked with have ended up at Facebook. I'm sure there are decent people there, but I couldn't personally work there in good conscience.
- JeremyBanks 5y agoYes, thank you for pointing out what has been the fucking obvious to everybody outside of Dang's Den of Dangerous Dummies. Your associates are easily duped marks. Facebooks pattern of incompetent negligence dates back to the first days of the company, and had never changed. Talk is cheap, lying to yourself is easy. But when a company has spent 15 years showing us how little they care about people, at a systemic level, people should have caught on by now. Your associates have been too blinded by ego and money. It's pathetic and morally unforgivable. As is Dang's moderation of this site. You're a bad human, Dang, and you associate with some of the worst.
- sgregnt 5y ago> But no one can see the forrest from the trees. Who are the people to be bold enough to speak for "everyone". You are definitely not speaking for me. I personally get a lot of value from facebook. I never had any problem with it in any respect. Use it to communicate with my family around the world. Used it to rent my apartment, sell thing on marketplace. I keep in touch with people I know. And have very thoughtful and enlightening political discussions that help me do the right choice who to vote for and stay informed. (The only other place with better discussions is hacker news thought)
- sjg007 5y agoFacebook just needs to look at itself from a complex interacting systems point of view. It is the structural incentives in the system that cause the problems. So yes, evil and discrimination can be an emergent problem even though no individual intends harm. Then you might also have bad actors who exploit those structural incentives/weaknesses.
- diegs 5y agoAaron Swartz wrote a great book review of Moral Mazes[1] which touches on this. http://www.aaronsw.com/weblog/bizethics http://www.aaronsw.com/weblog/bizethics