39 ms·
We're building a dystopia just to make people click on ads (2017) [video]
- soundpuppy 9y agoThis is the only reason why I would support dropping net neutrality. If the ISPs charged more for content, we could potentially see an ad free future!
- sockgrant 9y agoI’d rather have ads.
- walrus01 9y agoThis is ultimately not about ads, as Zaynep points out. It's about building an architecture of self-reinforcing social manipulation on a large scale, while how it works (and the fact that it is being done at all) remains totally opaque to the persons who are part of somebody's A/B experiment.
- eloff 9y agoWhat makes you think that money would go to content creators? Net neutrality and ads are almost entirely orthogonal.
- helthanatos 9y agoISPs are paid to handle the connection between you and the WWW. The bandwidth they charge you for is the highway. Them throttling services is not fair because you're paying for that highway. What about them charging more would make you think the rest of the internet will eliminate ads?
- quadrangle 9y agoThat's like saying that because we hate traffic, we should privatize all the roads and let for-profit companies control them and toll them however they want because they might potentially solve our traffic problems! I mean, it's more like if we had already privatized nearly all the roads, the companies covered them with orders of magnitude more billboards along with tolls, and you say "we should let these companies charge different tolls depending on brands of cars or have preference for drivers going to certain destinations over others, because maybe if we let them do that, they'll take the billboards and cameras away…"
- drawkbox 9y ago> If the ISPs charged more for content Multiple problems here: - The ISPs already charge too much and little of it is going towards innovations/network advancement, instead they want to be content creators and ad platforms instead of charging more to get to gigabit and beyond. ISPs need to get back to innovating on providing better/faster internet service, what they are. - ISPs should not be involved in content/ads/selling private data as that leads to bias and throttling, we need to have a separation of power from ISPs, the network gateway to the internet, and content creators on top of the internet. When is it a good idea to have content creators own the network outright? All that leads to is bias, preferential treatment and monopolies (furthering them). We have made immense mistakes in 2017 allowing ISPs to sell your private data, remove privacy protections at the network level AND the removal of net neutrality. Net neutrality makes the network provider neutral, simple as that.
- fsloth 9y ago1. There are other markets than US. Europe probably not follow suit even if US allowed it's utilities more rent seeking 2. Market for adds and ISP:s operate on different levels. Just because the downstream utility offering the datastream becomes more expensive, it does not mean content providers would echew ads. Sure, the ISP might want a cut of the third party add but that does not translate to any consumer benefit
- wvenable 9y agoNet Neutrality is about taxing content, not charging for it. Right now everyone (you, your neighbor, Netflix, Facebook, Google, ISP themselves) already pay to move bits between each other. ISPs want the ability to extort money from end-nodes of the Internet who they don't currently have any direct business relationship or physical connection with. Right now it's all just bits come across their network from peers but if they can start blocking traffic from specific sites, like Netflix, they can also make deals to ensure that doesn't happen. Maybe even make those bits move a little bit faster. In no way does this lead to an ad free future. It would probably lead to more ads as content providers would have additional costs to recoup that they don't currently have.
- johnsonjo 9y agoThis was a great speech she wasn’t trying to say all algorithms are evil or that machine learning is evil, but despite it having good consequences it can just as easily bring about a great evil. Not only do we have to be aware of hidden biases in machine learning that could be doing unethical things, but we need to be aware of the great power and effects these algorithms have on those they are being used on and how they can be used to manipulate. Near the end she states, “Many of these ad finance platforms [e.g. Facebook, Google] boast that they are free. That means that we are the product that’s being sold. We need a digital economy where our data and our attention is not for sale to the highest bidding authoritian or demagogue.”
- FranzFerdiNaN 9y agoShame that CS people seem among the least interested in ethics, as it's just such a bummer when you have to consider anything else but technical solutions. It's why the field really needs the humanities.
- uoaei 9y agoI'm doing my Masters right now and taking a look at the job market / discussions about it. I'm stunned to see people talk about Palantir etc. as if it's just a thing you need to do to get enough money to live comfortably and not the enabling force that is bringing about next-gen warfare with more capacity to kill than all previous technology combined. People go into "defense" because planes flying themselves is cool but that's where their consideration ends. I really wish more people thought about what their efforts enable, directly or otherwise. Like it or not, we are all connected, and there are causal relations between your actions and the harm (or benefit) of others every day. Try to minimize that harm.
- infimum 9y agoI have a good friend who just finished his Master's in CS and considered taking an internship at Palantir. I was very apalled at first how he could even consider to work for a company that are obviously the 'bad guys'. He comes from one of those countries your president considers a sh*thole and scoring that internship polishes his CV enough so that he can get a stable and high paying job which will allow him to stay and not have to go back there. Can't really bame him....
- squarefoot 9y agoIt's not just about viral videos. People in general is being educated to trade being with possessing in the pursuit of an immediate short time satisfaction (which is sad because someone could take away what you have but not what you are). So it makes perfectly sense to me that driving people into sadness, paranoia etc. in many ways (news, music, movies etc.) could also be not just exploited but willingly planned for business reasons. This goes beyond the obvious "someone could invade the country -> buy more weapons" or "the big one quake/tsunami/plague etc. is coming soon -> amass food and stuff"; if people is being driven into thinking their life is miserable or they're in danger, most of them will seek immediate gratification by buying more of this or that.
- gt_ 9y agoIf anyone wonders how we got to this point, I think that is understandable. Here are a few thoughts: It’s easy to overlook how much advertising works. We each have a limited supply of bandwidth for perceiving the world we live in. The result is a high demand for undermining that perception and using it to manipulative ends. Authoritarian dystopias from books and films usually illustrate force because force is more immediately graphic. It also reflects the dismal state of a dystopian existence. Manipulation would look a lot different. Fear of manipulation is a fear of knowing someone else is trying to manipulate you. We don’t regularly notice evidence of brands and companies trying to manipulate us, but most of us understand they are incentivized to. I have worked in advertising for almost a decade and the truth is much worse. Although individuals who work at companies may be on your side, they get paid to spend their days doin what the company tells them to. Even managers and CEOS may be great people but when they go work, they are an employee. They have a duty to the company. And, the more efficient and skilled we get at manipulating members of society into behaviors which direct money our way, the employees will remain working for the company. Are the employees immoral? Not from the perspective of the family they support. And whose opinion is more important? The family’s. It’s pretty simple that we cannot expect individual decisions to compete with those of the profit-motivated companies they work for.
- TeMPOraL 9y ago> Are the employees immoral? Not from the perspective of the family they support. And whose opinion is more important? The family’s. It’s pretty simple that we cannot expect individual decisions to compete with those of the profit-motivated companies they work for. We could expect more on a social level, though. I still don't fully understand how did we get to the point when marketing became a respectable occupation. Something young people dream about being part of, when they learn to be a graphic designer, or a programmer, or a media person. I guess it's the consequence of how much money the industry makes. But looking at it from the top, we're literally celebrating the profession that's meant to exploit and hurt other people. If I came to you, as a friend, and did to you what half of the adtech companies do to people at large, I'd get - rightfully - punched in the face. And yet we tolerate that happening at scale.
- 9y ago
- csdreamer7 9y agoI remember reading an article (somewhere) years ago that criticized Silicon Valley for spending so much money to hire bright people to design a better way to click on ads. I thought that was a real dystopian future. Now Facebook is finally dying... I haven't been on it in ~6 months. People are paying for more and more subscriptions. Nextcloud is becoming a better and better replacement for Gapps. DuckDuckGo is good enough I can 'google' for 95% of my stuff on it. Firefox is now competitive with Chrome. I think we are better off now then we were a few years ago.
- Freak_NL 9y ago> Now Facebook is finally dying… Doubtful. Facebook is not just facebook.com, it's the whole package of FB Messenger, WhatsApp, Instagram, etc. People may uninstall the mobile app and limit their Facebook access to their laptops or desktop computers (that's a popular response among my colleagues), but I don't even know anyone who has actually deleted their account — aside from the folk who never had one, like me. I also get the impression that usage of Facebook and related services differs greatly from country to country, and from demographic to demographic. This article¹ from 2014 on WhatsApp usage isn't joking; In countries like mine (the Netherlands) not using Facebook-owned WhatsApp (like me) is rather exceptional. If I had kids they would miss out on basically everything (playdates, birthday parties, changes in schedule for sports/scouts/etc.; not to mention becoming social recluses because all their peers (or their parents when they are younger) are on Facebook/Instagram/WhatsApp) if I kept refusing to use Facebook's offerings. Facebook is not going anywhere soon (although I wish it was). 1: https://www.wired.com/2014/02/whatsapp-rules-rest-world/ https://www.wired.com/2014/02/whatsapp-rules-rest-world/
- drawkbox 9y agoFacebook is also Oculus, React, Onavo, Facebook Live and their video platform is trying to compete with Youtube, and they have bought and consumed lots of technology, developers and data from companies that do analytics, deep learning, tracking, location, development tools (even some good ones they EOL'd like Parse) and more. If the Facebook site/app goes the way of AOL/MySpace, which it won't for a long time, they have already prepared for that.
- wanda 9y ago*to make bots click ads
- bwang29 9y agoJust imagine one day, some algorithms completely take control of/help us decide what we eat, who we date, where to travel, who we talk to or make friends with, what job offer to take, what subjects to study in school, what startup ideas to invent. Then imagine that 100 year later, the original developers of these intricate algorithms retired, passed away, complex system got maintained by automated tools and programs, and the outcome of these algorithms become more and more obscure. Eventually, the complex machines and A.I. algorithms will be looked as mysteries to our grand grand grand children and they will study them as we're studying nature today..
- Swizec 9y agoTo the nontechnical we’ve already built god. A fav anecdote of mine is somebody once asked their Lyft driver how their day is going. And the driver replies: I have been blessed by the algorithm. It brings me much rides. If you have no mental models of how these things work, they may well be gods and the people who make them may well be high priests performing mysterious incantantions to bend the gods to their will. Kinda scary.
- walrus01 9y agohttps://en.m.wikipedia.org/wiki/The_Gods_Must_Be_Crazy https://en.m.wikipedia.org/wiki/The_Gods_Must_Be_Crazy Brought into a modern era where , in a world with $50 Android phones and cheap/free Facebook "free basics" walled garden internet, people who are only one generation removed from subsistence farming lifestyles are suddenly encountering meme warfare and predictive algorithms.
- Swizec 9y agoI love that movie! I watched it as a kid and to this day I remember two important facts: 1) Everyone recognizes a Coca Cola bottle 2) To defeat a hyena you must appear to be taller than the hyena
- anvandare 9y agoAnd this is how the Cult Mechanicus begins. :)
- fragsworth 9y agoA friend of mine had this idea that there's a path towards Facebook's AI learning to actually kill people. If they take a certain approach to machine learning (which they may or may not), the following could happen: A machine learning algorithm might notice that when someone commits suicide, there is an uptick in activity on Facebook that follows the event. It may determine, then, that a "suicide" event is "good". If they try to use feeds to drive more long-term site activity, the algorithm could learn a correlation between certain types of feed posts and suicide. In other words, if a user's feed starts to look a certain way, they will be more likely to commit suicide. The algorithm could then see this as "good" because it is also related to the spike in overall activity, and promote these kinds of feeds. It then becomes a feedback loop where the algorithm is triggering people to commit suicide.
- flashmob 9y agoI have some possible evidence to this theory. At around x-mass / new year, Facebook flashed a message on my wall which said "in 2017, you received 0 birthday wishes". (Screenshot reported by others https://goo.gl/images/YWfsqb https://goo.gl/images/YWfsqb). I thought it was amusing since it sounded like a bug, it looked like the engineer forgot to account for the special case where wishes == 0. However, putting your comment into perspective, I now think it was most likely a well-calculated tactic, perhaps generated by an AI as you suggested and I guess it wouldn't be shown unless it was A/B tested. Interestingly, the message was shown around xmass / new year, where people tend to be more vulnerable to suicide / self harm.
- codesternews 9y agoAI algos are very easy to implement. But no one can think and know its consequence. Its just biases and weight. What if we miss something or we can not able to predict cases like this or as we do not know how algo will behave. Than we are creating our own destroy ship.
- walrus01 9y agoBlack mirror season 4 episode ...
- mizay7 9y agoI really like her commentary and glad she is getting more attention. I think the issue is the magic of free and the irrationality of humans. Free creates irrational responses. People will use a lot of a thing if its free even if its bad rather than dealing with the perceived loss of paying 2 cents for something better. So as long as no one figures out how to make micro-transactions cognitively easier than free stuff then free tech will prevail. And payment will be harvested via information and attention. The dystopia we are building is not because we want free stuff, but because we are too lazy to make the choice about spending 2 cents. I am trying to change that with oalrus.com but we shall see if i mange to build a large enough of a list of alpha users to give the network a chance.
- dasyatidprime 9y agoThere's a secondary common-knowledge/coordination effect here, though, it's not just “individuals being lazy”: if someone gets antsy about whether ey will look awkward in front of eir friends for making the assumption that they will be willing to spend on something, then that feeds into the feedback spiral of “I don't really believe it'll work and I feel reluctant and don't want to tell people about this in case it's uncool”. A colleague of mine said that this suggested what was really necessary was to allow simple prosocial spending that wasn't too in-your-face, along the lines of how it's possible for one person to rent a game server for several people. Less individual anxiety over spending, since among other things there's enough of a social script for that.
- mizay7 9y agoYeh, this is one of the reasons network effects are so powerful and so effective market capture. Anybody who wants to push against that is going to have to spend a lot of time and resource getting enough users to create even an echo of a network effect and overcome those individual insecurities that you mention.
- invalidOrTaken 9y agoI don't think people are averse to 2-cent payments. I can imagine a scenario where I regularly spend money on the Internet besides Amazon. I don't know how much I've spent on Steam, for instance. What people are guarding against is optimization. I don't mind paying 2 cents. I do mind paying 2 cents and then becoming marked for upsell and becoming subject to a full-fledged marketing campaign, or having some recurring 2-cent payment be changed to $20. Cognitively, I know that I am no match for the kilonerds out there trying to extract money from my wallet. So the only move is not to play.
- taurath 9y agoSo funny to see these posts here and getting votes - wasn’t too long ago (literally months) that practically anything against the ad ecosystem was impugned. Granted, it may not be the same people speaking or talking, but what of you, dear lurker? Have you finally changed your mind on the value of these platforms?
- chx 9y agoThe problem is much deeper: in the roughly 25 years of WWW we have not really figured out better ways than ads. In the fourth quarter of 2017, Facebook had 2.2 billion monthly active users, ad rev was 12.779B thus if active users on average paid somehow a little under two dollars a month, it'd be the same. I am not saying, by far, that a flat fee is realistic, I am just showing there's a lot of room for improvement.
- cyphunk 9y agoyou point out something important. for-pay models don't properly deal with income disparities. you can be sure that for a portion of current 2.2b users $2 a month for access would be a significant chuck of their income.
- dorgo 9y agoMany possibilities to overcome this. Tell N friends about us and you get a month free subscription. Deals, coupons etc.. There are ways to achieve price discrimination. Who doesn't can/want to pay can get the service for free but has to endure a little more inconvinience.
- doyoulikeworms 9y agoFreemium + IAP does this well, but I’m not sure how you could build a Facebook killer on that model.
- deckard1 9y agoWhat's the benefit to Facebook for catering to such people? Presumably, advertisers can only sell cars to people that can afford cars. Or is this where Cambridge Analytica comes in? Then the equation stops being about selling things and becomes selling consensus. Maybe that was the plan all along.
- lmm 9y agoThe cool "starving artist" types putting up their events/content on Facebook is what makes it valuable to the rich people they want to advertise to. So it's not as simple as just keeping the people who can afford to pay.
- HenryBemis 9y agoThe moment when I dropped facebook, was the time they start manipulating my timeline. One day I realized that they don't show me things in their posting order, but they were moving them around. I remember using a bookmark ending with .com/?sk=h_chr to beat them, but I gave up when I realized that this is cat and mouse game, and they will continue these shady practices. [1]: https://www.theguardian.com/technology/2014/jul/02/facebook-apologises-psychological-experiments-on-users https://www.theguardian.com/technology/2014/jul/02/facebook-... [2]: http://time.com/3951337/facebook-chronological-order/ http://time.com/3951337/facebook-chronological-order/
- HenryBemis 9y ago15m 34s, Zeynep says: "as a public and as citizens" [1] And HERE is the problem. Facebook sees us ONLY as Product (our data) that can manipulate/buy/sell - and treat us accordingly. Advertisers see us ONLY as Consumers they can sell to - and treat us accordingly. Politicians see us ONLY as Votes (not voteRs) they can snatch - and treat us accordingly. And we let them. [1]: https://youtu.be/iFTWM7HV2UI?t=934 https://youtu.be/iFTWM7HV2UI?t=934
- passivepinetree 9y agoOkay, so what is to be done about it?
- ModernMech 9y agoStart with the politicians. Vote out anyone who doesn't support campaign finance reform. Then we can make our government a little less sociopathic.
- etherealG 9y agoStart with your attention. The impact will be even bigger than your vote. Avoid services altogether that abuse you, even if there’s some benefit you gain out of it.
- 9y ago
- wruza 9y agoLate to the party as usual, I think this speech underestimates the will of companies to do what’s described. Most cynical actions are powered by money and harm anonymized/faceless groups that “hey, they were suicidal anyway”. The simple fact is: you cannot dislike, remove or train networks to get what you want – you eat what is served instead, liked or disliked. Your opinion is not an argument of targeting function, only attention is. My youtube feed was full of crap until I removed all suggestions. (Did you know you have to remove it 3-5 times for it to not show up again?) And still, it presents that toxic whatnext thing, which my inner self often treats no less than disgusting. I CANNOT find the content I really like with all the searches and smart ordering. I only get it from random articles by pure chance. The only way to take control of it is to make modern tech available to wide public as in next-next-done, not as a github-link. The internet and all its power is still here for us from the start, but heck most turn into companyname zombies because everyone already is and that’s the easiest way to communicate. Instead of spending time on ultra-asynchronous scalable tech, could we stop and think of small businesses and just people who want to publish and exchange content in their small volumes? The Web Suite consists of a simple but overcomplicated browser app, instead of a full platform to create, publish and manage the content with few design hints to not turn it into myspace. Until that changes, we all, no matter #deleted or not, will swim in crap that is pushed by so-called media giants (media jerks in my view). Removing yourself from everywhere doesn’t help, as it doesn’t help to be healthy in mental asylum.
- agumonkey 9y agoThe previous system of TV + commercials wasn't perfect. It's often mocked and criticized for over romanticizing products (from daily health to polluting cars to cigarettes). But these era seems worse because it's disguising it's aim behind "real" ads (because they don't coat the product in glamour, because they use "more data") but in the end it's as bad if not worse as before; just a web based reincarnation of the same needs to make money.
- cameldrv 9y agoThe average American has maybe 3-4 hours of discretionary time per day. They choose to spend an hour of it on Facebook. The newsfeed algorithm could be optimized to do anything -- Facebook's own experiments show that they can make people happy or sad. They choose to maximize their own revenue. There is immense potential to improve the lives of their users, and they choose to sell an unimaginable amount of human potential for what amounts to 30 cents per hour.
- aurelien 9y agoAnd because United Nation don't get the flag on the point that it goes against the evolution of Humanity.