12 ms·
Traffic to Wikipedia terrorism entries plunged after Snowden revelations
- steve19 11y agoWikipedia stats are painful to browse, but here are some numbers: Al-Qaeda / US Army / ISIS in January 2016 http://stats.grok.se/en/201601/Al-Qaeda http://stats.grok.se/en/201601/Al-Qaeda (~ 3k / day) http://stats.grok.se/en/201601/United%20States%20Army# http://stats.grok.se/en/201601/United%20States%20Army# (~ 2.5k / day) http://stats.grok.se/en/201601/Islamic%20State%20of%20Iraq%20and%20the%20Levant# http://stats.grok.se/en/201601/Islamic%20State%20of%20Iraq%2... ( ~15k / day) Al-Qaeda / US Army / ISIS in May 2013 (before Snowden's revelations & before ISIS/ISIL was known in the West[0]) http://stats.grok.se/en/201601/Al-Qaeda http://stats.grok.se/en/201601/Al-Qaeda (~ 5.8k / day) http://stats.grok.se/en/201601/United%20States%20Army# http://stats.grok.se/en/201601/United%20States%20Army# (~ 3.5k / day) My conclusion, traffic is probably changing due to what is in the news rather than anything else. If the US Army is sent in to invade another country, their wikipedia page will be back on top. ISIS was way higher last year, average about 25k/day in the middle of 2015, but the news media are tiring of them and they are also fading away. That said, I was about to send a completely legit email yesterday that had the keywords "pipe bomb", "suicide vest", "IED", "Al-Qaeda" and "Mali" in it (a friend just lost two of his men in Mali), but I decided to self-censor for the benefit of the recipient rather than myself. [0] ISIS was technically announced at the end of April, but they were not well known and the page was just a stub. It fell below threshold for collecting page view stats. https://en.wikipedia.org/w/index.php?title=Islamic_State_of_Iraq_and_the_Levant&oldid=125623633 https://en.wikipedia.org/w/index.php?title=Islamic_State_of_...
- atdt 11y agoThere is a better (and more comprehensive and accurate) API for page view data now: http://blog.wikimedia.org/2015/12/14/pageview-data-easily-accessible/ http://blog.wikimedia.org/2015/12/14/pageview-data-easily-ac... , API specs at https://wikimedia.org/api/rest_v1/?doc#/Pageviews_data https://wikimedia.org/api/rest_v1/?doc#/Pageviews_data
- machrider 11y ago> My conclusion, traffic is probably changing due to what is in the news rather than anything else. I appreciate you throwing some data for a few keywords together in your comment, but you'll excuse me if I lean toward trusting the published paper instead. FWIW, paper is downloadable here (at least, for now): http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2769645 http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2769645
- steve19 11y agoDid you read the paper? They did not even track the ISIS pages. They had a small group of pages which they tracked and a control group (see the appendix) They did not compare it to the news cycle, or consider that people are reading different pages about the same subject (AQ in Iraq for example being superseded by ISIS). Sorry if I sound harsh but this study was terribly executed. Doing it properly would require a lot more resources than Wikipedia daily page view dumps. I think the NY Times would be well placed to do a study on this using Wikipedia page views, their page views and their mentions of topics overtime.
- Baghard 11y ago> They did not compare it to the news cycle Such as the April 2013 Boston Marathon bombings. Or the rise of ISIL and Boko Haram in early 2013. I still think the study was well executed, but the instant effect seems to disappear when you remove the 6-7 months before mid june 2013. The long-term effect they claim to observe is more shaky. (I think one can find "statistically significant" groupings of say, Harry Potter articles, that show a similar peak and decline around the Snowden revelations.) Can we find more flaws in this paper?
- maho 11y agoI read your comment half-way, then upvoted it. I mentally prepared a response with further arguments against the size of the chilling effect. Then I read the rest of your reply and saw all the keywords. "Oh no", I thought, "I showed my engagement with this post by upvoting it!" Needless to say, I don't feel like arguing against the chilling effect anymore.
- marricks 11y agoMost illuminating is how this documented chilling effect can be used, "Penney’s work may provide fodder for technology companies and others arguing for greater restraint and disclosure about intelligence-gathering. Chilling effects are notoriously difficult to document and so have limited impact on laws and court rulings. More immediately, the research could aid a lawsuit filed by the American Civil Liberties Union on behalf of Wikipedia’s nonprofit parent organization and other groups against the NSA and the Justice Department." A study over a long period of time on many articles helps avoid the noise of news.
- Aelinsaar 11y agoAll I see are governments creating a vast global market for encryption of EVERYTHING. The more people feel threatened, and react through encryption, matters start to become really difficult if you want to spy on anyone.
- bobwaycott 11y agoAnd yet that provides just the right set of circumstances to push hard for laws that outlaw it or demand companies be able to bypass it.
- mancerayder 11y agoThat, or it creates a nervous impetus in the authorities to pass those laws before more sophisticated encryption and adoption move faster than they can respond to it.
- Aelinsaar 11y agoIt's an arms race where the only thing that really matters is sheer numbers of minds working on the problem. It's hard to beat the latest and greatest highly motivated teenager after all, when there are hundreds of millions of them, and your track record needs to be perfect.
- Aelinsaar 11y agoAll it takes is one country not playing along with that, producing encryption software without backdoors, and they make... all of the money.
- jlubawy 11y agoAnyone else find the photo's caption amusing? "A man is seen near cyber code"
- nxzero 11y ago"Cyber code"... :-) https://www.google.com/search?q=%22cyber+code%22&tbm=isch https://www.google.com/search?q=%22cyber+code%22&tbm=isch
- bobwaycott 11y agoI couldn't help but laugh.
- socceroos 11y agoI came here to remark about it too. What is this "cyber code"? XD
- mancerayder 11y agoI did after your comment lead me to it! There's more than one thing that's funny about it. Is it the word 'cybercode'? The man 'near' it, whatever that means? Or the nonsensical photo? Great stuff. They should have left out the caption for their own good.
- mjfern 11y agoOf course mass surveillance leads to a chilling effect. Personally, I'm now concerned about what I say in email, in text messages, in discussion forums, and in telephone calls. I fear that if I use the wrong words or visit the wrong websites, I'll trigger some automated system and will be put on some kind of watch list that will change my life. This is a very scary state of affairs. And unfortunately I don't see a near-term solution. The interests of government and corporations are aligned (reducing pressure to enact any serious privacy regulation). They're both looking to vacuum up as much personal data as possible for national security on the one hand and to develop new and improved revenue/business models on the other.
- 55555 11y agoMe too. How common is this? I deliberately avoid certain topics of conversation and often don't speak the way I truly feel out of fear it will hurt me down the line. I hate this reality.
- tn13 11y agoMy Muslim friend who is otherwise a nice guy told me how after Snowden incident some of his friends are avoiding him on all electronic media.
- feelix 11y agoI don't follow him on Twitter because I don't want to get hassled when I go through US customs since I'm from another country (NZ).
- tn13 11y agoExactly. If fear of handful of terrorists have made our communities this corrupt then sadly looks like the terrorists have won in shaking the very foundation of western societies. This decay is slow but more like cancer it gives slow death to a civilization.
- 11y ago
- tn13 11y agoAs an immigrant in USA who loved to read about religions,mythology and history I have stopped buying books about Islam and middle eastern history on Amazon I buy them in cash at B&N. I stopped using Quora completely too. My fear is that not just people who might be interested in Islam or middle east might get targeted but I am sure government will also target the Libertarians and anti-authoritarian people.
- slg 11y agoYou know what happened "shortly before" Snowden's leaks, two terrorists killed 3 people and injured hundreds others in a terrorist attack in Boston. Is that a good time to establish a baseline for number of page views? I'm not saying there isn't a chilling effect, just that I am highly skeptical of this measurement of it. Wikipedia pages on these subjects are practically news articles. They are going to be pretty highly linked with whatever is going on in the world at the time. Considering that, I would fully expect terrorism searches to be high after a recent terrorist attack and to drop as terms like "Al Queda" become less newsworthy on a global scale.
- garrettgrimsley 11y agoCTRL + F "shortly before" 0 results. Putting quotes around shortly before makes it seem like you are drawing from the linked story, but you aren't. A quote that is actually from the article: >In the 16 months prior to the first major Snowden stories in June 2013, the articles drew a variable but an increasing audience, with a low point of about 2.2 million per month rising to 3.0 million just before disclosures of the NSA's Internet spying programs. Views of the sensitive pages rapidly fell back to 2.2 million a month in the next two months and later dipped under 2.0 million before stabilizing below 2.5 million 14 months later, Penney found. They did not use the day or week of the Boston Bombing as their baseline. Don't misrepresent the research.
- slg 11y agoYou are right on the quoting thing. I could have sworn it said "shortly before" but it said "just before". My mistake. Although those are almost semantically identical so I am a little confused on why you are calling it out in such specificity. >They did not use the day or week of the Boston Bombing as their baseline. Don't misrepresent the research. Snowden's leaks came out less than two months after the largest terrorist attack on US soil since 9/11. Since they are measuring monthly stats, they are using either the month of or the month after the Boston bombings as part of their "just before" time frame. If you look at all those number, the 3 million is really the biggest outlier. Isn't it possible that views for these terrorist related pages generally falls between 2 and 2.5 million with 20-50% jumps in page views in the aftermath of large terrorist attacks?
- nxzero 11y agoMy guess is that for every person that goes silent, another that might not have, speaks up. Just polarizing the issue more than anything.
- jernfrost 11y agoIt has certainly enraged me, but while I might rail more against the surveillance state online anonymously I find myself much more careful in the public space.
- nxzero 11y agoGiven the volume of data you're leaking online, you know that you're not anonymous online, right?
- mikeokner 11y agoThis is a rather tired argument IMO. It's absolutely possible to be anonymous enough online to mask your real identity, especially from bulk, non-targed surveillance.
- nxzero 11y agoMy statement had to to with a specific individual who's posted a massive amount of pii online; if you have a specific claim related to bulk data collection, happy to address it.
- mirimir 11y agoPerhaps related: The number of "VPN privacy services" has increased greatly since mid 2013. And I've heard informally that subscriptions have increased dramatically for some older services. One might think that Tor usage would also have increased. However, a large botnet installed Tor in late 2013, so user counts since then are entirely unreliable.
- PlzSnow 11y ago"I fear that if I use the wrong words or visit the wrong websites, I'll trigger some automated system and will be put on some kind of watch list that will change my life" I'm afraid you've got caught up in a modern-day hysteria. Nobody is watching you or cares anything about what text messages you type or websites you visit.
- dang 11y agoWe detached this subthread from https://news.ycombinator.com/item?id=11586218 https://news.ycombinator.com/item?id=11586218 and marked it off-topic.
- fit2rule 11y agoThats just simply not true. There are automated systems doing precisely this kind of tracking. Did you not dig into the Snowden revelations and see just how bad it is? Because, its really, really bad. No, I do not want my data in some secret government organizations' computer systems, for secret analysis. Ever. It may not be of consequence to the current administration, but do we really want Trump to have the power that the NSA grants? Clinton? Do we really want anyone with that power? I think the biggest problem with the Snowden revelations is that, even now years after the fact, people don't seem to understand just how corrupt and how crippling the NSA security apparatus is, truly. Dig into the details and you will see that one of the most technologically advances tools of mass oppression is now upon us - and not just 'upon us', actually - but has been in operation now for over two decades. Just what effect it has had, we will never know. Maybe there are people who have been spirited away, detected by this system as the rising new radicals that will upset the apple-cart, and we have absolutely no idea who or what they were. Do you really trust the religious zealots in power over this machinery to use it appropriately? Really? Then you are a huge part of the problem.
- hargup 11y agoThat is if you are white and American, for everyone else the possibilities of getting harassed based on what you see, read or say are very real.
- deleted 11y ago[deleted]
- PlzSnow 11y agoThere seems to be a wholescale hysterical neurosis around the entire issue. The narrative on HackerNews is that every piece of electronic communication is monitored and stored. The majority of HackerNews contributors actually believe this.
- dang 11y agoWe detached this subthread from https://news.ycombinator.com/item?id=11586689 https://news.ycombinator.com/item?id=11586689 and marked it off-topic.
- DanBC 11y ago... While simultaneously building their own services which gather and store huge amounts of data about visitors and users.
- mirimir 11y ago;) But it's a plain fact that the NSA intercepts and scans whatever it can, wherever it can. And that it retains as much as it can, for as long as it can, following an elaborate triage strategy. Or at least, they claim so in various reports and presentations. It could all be bullshit, I suppose ;) Also, isn't there some evidence that Google helped the NSA develop XKeyscore etc?
- PlzSnow 11y ago"I am sure government will also target the Libertarians and anti-authoritarian people." This is a wild and extreme accusation with no evidence whatsoever. Welcome to HackerNews.
- dang 11y agoWe detached this subthread from https://news.ycombinator.com/item?id=11586264 https://news.ycombinator.com/item?id=11586264 and marked it off-topic.
- Gustomaximus 11y agoIt's not that wild when you read history about US government actions towards foreign/domestic organisations/individuals they deem have strayed to a point of challenging the status quo. The most obvious example is looking at how communism was treated post WW2. This I find amazing, not that I support communism, but that the government was so ready to act this way towards someones political choice, regardless of what that is. That's far from upholding democratic values. Another surprising one people dont realise if the CIA probably organised the removal of an Australian Prime Minister because he wanted to take the nation to a more neutral standing: https://en.wikipedia.org/wiki/1975_Australian_constitutional_crisis#Alleged_CIA_involvement https://en.wikipedia.org/wiki/1975_Australian_constitutional... So feeling this is a likely monitoring point seems a reasonable statement to me especially on any serious anti-authoritarian activity. As for evidence, that's always going to be a hard one, whether its happening or not.
- tn13 11y agoIt is not a wild and extreme accusation. The IRS is known to have targeted Tea party people. More subtle propaganda is already in action too: http://www.madinamerica.com/2012/02/why-anti-authoritarians-are-diagnosed-as-mentally-ill/ http://www.madinamerica.com/2012/02/why-anti-authoritarians-...
- Gratsby 11y agoThis is more a sign of the power of the media than anything else. The media is looking for a story. There's very little that's compelling out there. Terrorism keeps popping up because it gets clicks. Soon enough there will be another Kardashian or another Adrian Peterson to take the collective mind on to the next distraction.
- camillomiller 11y agoI would need to read the paper to be sure, but from what I gathered a simpler SEO explanation hasn't been given. With the Snowden leaks each and every media outlet started publishing reports on those topic. That means that the Google SERPs of relevant keywords started to be clogged by relevant articles and editorial contents that displaced Wikipedia entries from the first positions. I've done my share of editorial SEO stuff during the last few years and I've seen that happen many times for even smaller events. A more meaningful way of testing this would have been to have a similar sampling of entries from another topic to test against the key group. Maybe that's in the paper, we'll see when it's out. Still, the numbers are consistent with the fluctuation of positioning in Google results.
- vanderZwan 11y agoThat's a good point, although to nuance it a bit: > suggesting that concerns about government snooping are hurting the ordinary pursuit of information ... while they might be wrong about the cause (which is important of course), you could argue that the consequence remains the same; that depends on whether the articles and editorial are good replacements content-wise.
- camillomiller 11y agoWell, in that case we could also discuss whether Wikipedia could be considered the best information you can read. Also, would Wikipedia be as updated as, say, an investigative report about NSA misconduct published by the New Yorker? I mean, the absolute value of the medium has not been taken into account nor weighted in the study. Editorial worthiness is certainly something we can talk about, but I wouldn't consider it as a meaningful replacement for the lack of a statistically and numerically relevant point in the study.
- vanderZwan 11y agoAgreed on all points; I guess my point was that while flawed, the study at least highlights that traffic dropped to Wiki articles, and triggers this whole discussion.
- belorn 11y agoThis is a good start and I hope it will encourage additional studies into the chilling effect of mass surveillance. The only previous study that I have read is from Germany, and it looked at the effect from the then new Data Retention Directive. That survey showed that people would start refraining from calling help-lines, lawyers, doctors and priests as a direct result of mass surveillance.
- jernfrost 11y agoI do not feel comfortable about expressing my views about American security policy. Sure I say whatever here, but I planned on demonstrating outside the American embassy here in Norway, but I decided it was too risky. It has been uncovered that the American embassy films and photographs all demonstrators. I travel frequently to the US because I am married to an American and because of work. I don't want to risk getting on some secret list and getting problems when visiting the US. And let me tell you there is nothing I dread more than American border authorities. They are the worst of any country I have visited. My university or american authorities made some mistake when I left the US after a masters study. I got all sorts of shit because of that years afterwards on every visit. I got interrogated for probably an hour with all the same stupid questions repeated again and again. It didn't matter that I thought the issue got cleared up the first time. It was back to square one the next visit, while my wife and kids had to wait a long time not knowing what was going on. And that is just me, but I have so many friends and acquaintances with horror stories, some who swear they will never come back to the US due to their treatment. One guy was dragged into interrogation because he didn't keep his finger too long on the fingerprint reader. I got a friend in the neighborhood who happens to be brown. That is not a safe color in the US, because that is the terrorist color. He isn't a muslim and have been living in Norway the last 15 years. But no the border guards just started hurling accusations of him being a terrorist and that he was plotting something in the US, seemingly just throwing anything at him to see what would stick or get him off his balance. Like most Norwegians he travels on vacation all over the world a lot. Yet somehow this kind of shit only seems to happen in the US. You know how they operate in the US. As a foreigner I have no rights in the US, as is also evident from how they view collection about data about non-americans. So I don't want to risk anything that will get me in serious trouble. I can tell Americans are affected to. When my wife talks about Snowden with her family in America they get all nervous. They think it isn't something one should talk about. They got very upset when she used encrypted email and said that would get her targeted by NSA. It is all sad because I would have liked to live some years with the family in the US. It is a country which has a lot to offer. But police state feeling of the US is just creepy. It puzzles me that American are not more aware of the problem. How can so many be so convinced that America is a country with so much freedom. People kept parroting this to me when I lived there, but it was the lack of freedom that made me leave.
- feintruled 11y agoThis makes me wonder. On occasion, I have read the IS magazine "Dabiq" just to get some sort of insight into their messed up thinking (I think the CIA actually mirror the files!) As horrible as it is to say, I assumed because I was a white atheist this would be entirely fine and this explanation would wash should it somehow ever come up. If I was a Muslim though I wouldn't dare read it.
- sugarfactory 11y agoYou can read Wikipedia articles without letting them know which article you're reading by downloading the database dump of Wikipedia, which can be obtained at dumps.wikimedia.org.
- PlzSnow 11y agoI'm not "part of the problem" because the problem you describe doesn't exist. Yes I read the Snowdon revelations, who didn't? He described some bad practices, which were extrapolated into vast huge nonsense wholesale. There aren't radicals being "spirited away" wholesale by a huge technocratic dicatorship using advanced tools of oppression. It's just conspiratal, fantastical cringy nonsense.
- dang 11y agoWe detached this subthread from https://news.ycombinator.com/item?id=11586843 https://news.ycombinator.com/item?id=11586843 and marked it off-topic.
- fit2rule 11y agoSorry, but you are just plain wrong. Snowden revealed that the rabbit hole is very, very deep. The Internet has been being recorded for fifteen years now. The spy agencies have given themselves free reign over our technology, altering it according to their secret doctrines. Do you think this is just a 'bad practice'? >There aren't radicals being "spirited away" wholesale by a huge technocratic dicatorship using advanced tools of oppression. It's just conspiratal, fantastical cringy nonsense. How would you know? We, the people, no longer have the ability to determine if this ever happens. It's no conspiracy, either: its a fact. The NSA is a sovereign unto itself. I'm sorry to tell you this, but you need to look closer. You are trivializing the truth, which is a heinous apparatus has been constructed in order to control us all.
- PlzSnow 11y ago"a heinous apparatus has been constructed in order to control us all" Sorry, I don't think reasoned debate is possible with you, you're on the fringe extremes with your beliefs. Hope you're feeling more positive today. Take a walk and end enjoy life.
- fit2rule 11y agoIf you think its acceptable that a secret government agency can inject itself in any technology device, for whatever purpose it sees fit, without any recourse for the citizens of the country it is supposedly 'supporting', that its acceptable for an agency to have the power to spy on everyone who has ever used a computer, cell phone, or any Internet device, for whatever reason it deems suitable, without oversight from the very people from whom it derives such power, then there really is no decent conversation to be had, here. "Fringe extremes" is just your way of saying 'you don't think what the collective mind wants you to think, why are you not like everyone else', and in that statement you have said more than enough. You don't think its at all disagreeable to have to 'conform to what society thinks' or else .. "you must be mentally ill"? Seriously, examine this position. Its a cult-like mentality that doesn't improve conditions - it simply allows those who have the power to continue to extend it and interfere in every day life. Are you okay with having a shadowy organization, with everyones data, beyond the reach of the people you profess to be a major 'part of' in your collective mind-set? Because I am not. I live in a place where the echoes of tyranny and the heinous information-apparatus it depended on still ring throughout the land. And here you are, safely justifying the creation of a new one, with little consideration for what it truly means that we have no control over the digital domain and its masters, any more. Popular opinion is just one way to justify being too lazy to form ones own ..