19 ms·
Cloudflare is turning off the internet for me
- phillipseamore 7y agoTo be fair, site owners are in control of those settings.
- falcolas 7y agoWhat are the defaults of those settings? What percentage of site owners change the defaults? It's kind of like saying "it's your own fault you didn't de-select the "track everything I do" checkbox on our privacy page".
- deleted 7y ago[deleted]
- deleted 7y ago[deleted]
- hmhrex 7y agoWhich settings would those be? I'm using Cloudflare for a couple of my sites, and if I can fix this, I will. Otherwise I'll stop using Cloudflare.
- jagger27 7y agoThe simplest way is just to use CloudFlare for DNS only (grey cloud button) until you're under attack. edit: do not follow my advice
- chewmieser 7y agoThis is a horrible recommendation and will ensure that the attack can continue after activating CloudFlare. You've already exposed your origin's IPs in this circumstance.
- jagger27 7y agoYikes, of course.
- gruez 7y agocan't you ask your provider for a new one?
- Eikon 7y agoYour provider would have to nullroute the ip under attack and you'll have to wait for DNS cache expiration so your updated zone is being distributed to clients. Short TTLs are not honoured by everyone so you'll experience some downtime.
- hmhrex 7y agoIs there any way around that? I'd rather set it and forget it so I don't have to worry about the attack in first place.
- sgtfrankieboy 7y agoIn CloudFlare go to "Firewall" and then click Settings on the right. Here you can set the Security Level and if you want to use Browser Integrity Checks among other things.
- hmhrex 7y agoThanks! I will look into that further.
- Dunedan 7y agoThere is another side effect of visiting sites served by CloudFlare with disabled JavaScript: Email addresses (or any other words separated by an @) appear as "[email protected]" instead. Take this blog post from CloudFlare themselves for example: https://blog.cloudflare.com/serverless-performance-comparison-workers-lambda/ https://blog.cloudflare.com/serverless-performance-compariso... That's just ridiculous.
- partiallypro 7y agoHow is it ridiculous? It's called email obfuscation (it can be disabled within Cloudflare) it's to stop spam bots from ripping email addresses from websites and adding them to mailing lists.
- tcd 7y agoBecause their regex is crap and if you have @twitterHandle or something with a legitimate "@" you just see the obfuscated version. It's laughably adorable to think it's actually solving a problem or helping in any way, the 'bad actors' it's trying to prevent probably have a work around anyway.
- deleted 7y ago[deleted]
- vageli 7y ago> It's laughably adorable to think it's actually solving a problem or helping in any way, the 'bad actors' it's trying to prevent probably have a work around anyway. They do—changing your user agent is trivial.
- sp332 7y agoWhy would I want to send an incorrect user agent? There's no point having one if it's just going to lie anyway.
- 7y ago
- asdf21 7y agoIs he using a headless browser? Interesting that he won't give specifics.. Edit - Whoops, read too fast.
- nattaylor 7y agoHe links to https://www.qutebrowser.org/ https://www.qutebrowser.org/
- dijit 7y agoI link the exact browser I use. It's called qutebrowser, it's powered by QtWebEngine, which is chromium underneath. Basically Chromium wrapped in python with vim-keybindings.
- RyanK24 7y agoWe're currently investigating. Should have more info soon.
- core-questions 7y agoIt's okay, don't worry. Cloudflare would never use this incredible power for political purposes... ...oh wait, yes, they have and they will again. We've given them the power to censor and with the power increasingly comes the onus to do so, to satisfy the political whims of an elite that doesn't like anything counter to their narrative.
- deleted 7y ago[deleted]
- corobo 7y agoDo you have any evidence of this? I'd take a dodgy looking blogspot URL over absolute nothing
- kradeelav 7y agoOP is most likely referring to the news/articles when they shut down service for neo-nazi sites. There may be others I'm unaware of.
- Valmar 7y agoYou mean websites that others smeared as "Neo-Nazi" sites, and then whined about to Cloudflare. Nothing less than a means of censorship ~ brand your opponent as "Neo-Nazis" and get them silenced.
- Rebelgecko 7y agoIn the past, Cloudflare were free speech absolutists. They accepted customers in a content neutral way. When people tried to get them to deplatform ISIS websites, they said this: One of the greatest strengths of the United States is a belief that speech, particularly political speech, is sacred. A website, of course, is nothing but speech... A website is speech. It is not a bomb. There is no imminent danger it creates and no provider has an affirmative obligation to monitor and make determinations about the theoretically harmful nature of speech a site may contain. When people started asking why Cloudflare hosts racist and neo-nazi content, they eventually relented from their free speech position and stopped hosting one called The Daily Stormer. The CEO wrote a big blog post about how what he was doing is bad for the internet and free speech but he's going to do it anyways (I'm paraphrasing, read original words here: https://blog.cloudflare.com/why-we-terminated-daily-stormer/ https://blog.cloudflare.com/why-we-terminated-daily-stormer/). Since then, they've stopped working with a number of other sites due to content, like 8chan. I think it's a damned if you do, damned if you don't kind of situation for Cloudflare. They weren't really looking for political battles, but ended up having them anyways. I think this Wired article adds some interesting perspective: https://www.wired.com/story/free-speech-issue-cloudflare/ https://www.wired.com/story/free-speech-issue-cloudflare/
- stopads 7y agoI also refuse to complete captchas because I'm not interested in giving a trillion dollar company my free labor to help train their models. I'm really close to just defaulting JavaScript off entirely, the web is becoming so much worse by the day.
- djannzjkzxn 7y agoThey’re also using your labor to train models by serving you pages and checking which links you click. No js required.
- reaperducer 7y agoJust because he's being exploited by Google in one way doesn't mean he has to allow himself to be exploited in every possible way.
- djannzjkzxn 7y agoIf you care about being exploited, it’s worthwhile to know when it’s happening, so you can consider your return on effort for avoiding it.
- danem 7y agoDo you consider "exploitation" here to be negative or unethical? He is willingly using Google because the provide amazingly useful services completely free of monetary charge. Are you objecting to the fact that Google benefits in some way by providing this service?
- pferde 7y agoI've had js turned off by default for many years now, and don't feel like I'm missing out on anything important. Your mileage, of course, may vary.
- dijit 7y agoYou're a stronger person than me. I keep trying to live without JS but so little of the internet works. * Gitlab/Github (obviously) * Google maps (obviously) * Linkedin... (uh... less obviously) * Outlook * Infoq.com * Rust docs * Google Cloud Docs etc; A lot of the internet is butchered without JS. I really want a way of just blocking third-party JS (IE; the site can deliver JS, but not anything it tries to import unless whitelisted). But that seems to be hard with qutebrowser. FWIW uMatrix apparently has a method doing this.
- KaoruAoiShiho 7y agoCloudflare blocks an enormous number of bad actors for me, so I quite like it.
- dijit 7y agoIt wouldn't have a place if it didn't provide value. I am a normal user though and I (thought I had) absolutely no way of viewing your content now if you use cloudflare. Turns out using Chrome works...
- lucb1e 7y agoI'm curious about the specifics because through my and my colleagues' simulation of "bad actors" (ethical hacking) I've never once gotten stopped by CF. I thought the point was anti-DDoS by just proxying your traffic through someone with bigger pipes. That they do TLS offloading to filter n-days like Heartbleed helps as well of course, but those are super rare events and it sounds like what you mean is ongoing. What kind of bad actors do you mean, and what kind of sites? Don't have to mention the domain or anything, just that it makes a difference whether it's a web shop (financial risk I guess), more like a forum (spammer / hater risk), or something else.
- judge2020 7y agoGenerally, the DDOS protection even at layers 3 and 4 is a blessing. For a layer 3/4 attack, all a malicious actor really needs is a bunch of average internet connections anywhere; and depending on your server hardware, it might be inexpensive to keep it down since those IPs are cheap. CF just drops all packets from these "literally 99% of traffic is malware" IPs on the network layer. But a layer 7 DDOS attack, when going through Cloudflare, means the malicious actor needs to have IP addresses that are at least not complete trash in terms of IP reputation. Getting access to a botnet and access to these IP addresses isn't exactly prohibitively expensive, but it's a much larger barrier to entry. It's even harder to get taken down by a layer 7 DDOS attack on Cloudflare if you use "im under attack" mode, assuming your attacker isn't paying even more for the botnet to run something like Chromium or node to hit your website. Finally, while Cloudflare doesn't actively do this for small-scale DDOS attacks (since it might just be a spike of users), they do have Gatebot for the larger scale ones https://blog.cloudflare.com/meet-gatebot-a-bot-that-allows-us-to-sleep/ https://blog.cloudflare.com/meet-gatebot-a-bot-that-allows-u....
- psz 7y agoBecause the author using a niche browser (QT wrapped in an app), this might be Browser Integrity Check. It's purpose is to block non-browser like behaviour common for spammers/malware. That would also explain switching to Chrome fixes the issue. https://support.cloudflare.com/hc/en-us/articles/200170086-Understanding-the-Cloudflare-Browser-Integrity-Check https://support.cloudflare.com/hc/en-us/articles/200170086-U...
- szczepano 7y agoSo if your browser agent is not firefox, chrome, safari internet can stop working. What a great side feature.
- JakeTheAndroid 7y agoYeah, because most custom browsers are malicious. They have the data to prove it. This isn't a side feature, it's a direct feature that is 100% intentional. They maintain a backend whitelist of known "good" user-agents. Curl is on that list and there are a few others outside of the big players. Most people building custom browsers are doing it to do something Chrome would disallow. One instance would only supporting one, weak-ish cipher forcing TLS to use a predictable cipher instead of choosing the best available encryption for transit. While I agree some people have cool browser projects that would be nice to use, it's a side effect of bad actors abusing the system. Most of the annoying parts of Cloudflare exist because bad actors have abused the system.
- JohnFen 7y ago> This isn't a side feature, it's a direct feature that is 100% intentional. So Cloudflare is intentionally breaking the web? Good to know.
- llama052 7y agoNo they are doing their job of filtering out garbage from most websites, and it's an option that the site-owner can enable. Is this such a novel thing to look for outliers in web traffic and offer ways to mitigate risks?
- Liquix 7y agoThe problem presented by services like ReCaptcha and Cloudflare is a tough nut to crack. They're silently embedded in a huge portion of modern websites, and the average user will never even know about them. But it seems to be way too easy for them to blanket-ban or serve an absurd amount of captchas to powerusers, linux gurus, privacy geeks, or anyone with the wrong combination of browser+addons. And the failures (as in this case) are often silent, cryptic, un-fixable from the user end, and can prevent us from accessing massive swaths of the internet. Any thoughts surrounding this conundrum? Solutions: 1. Everyone stops using ReCaptcha/Cloudflare. - Never going to happen. They dominate the market because they are useful, well-made services. 2. Launch a competing product that accomplishes the same thing. - Good luck competing with these giants. Also, how would your implementation differ to solve this issue? 3. Powerusers and tech nerds must conform to 'normal' browser configurations and disable privacy addons in order to enjoy the internet with 'normal' users. - Two steps backwards in every conceivable way. The giants gain more invisible power and powerusers suffer decreased productivity/privacy. Not going to happen.
- sturgill 7y agoI’m a fan of Recaptcha v3. There are many actions where you can ask for some additional input in a non-puzzle way. Simple example is sending a confirmation email before signup when the score is below a certain threshold. Because I freaking hate those captcha puzzles...
- rstupek 7y agoExcept v3 has to be on every page of the site and that gives Google a full view of all traffic on the site
- WillPostForFood 7y agoSo does Google Analytics, so does AdSense. ReCaptcha V3 is probably the least used of the three.
- 7y ago
- tmoravec 7y agoCloudflare is also making TOR quite useless.
- asdf21 7y agoI don't know the specifics on this, could you elaborate?
- tmoravec 7y agoHalf the websites I visit give me the CloudFlare screen like One more step Please complete the security check to access <whatever>. Followed by either endless stream of ReCaptchas or one completely impossible.
- JakeTheAndroid 7y agoif captcha loops are still an issue, you should write in. JGC takes that stuff seriously. You're more likely to see a IP block, because most site owners do not whitelist TOR endpoints or specifically block them because it's mostly abuse.
- lucb1e 7y agoI'm guessing JGC is some dude that works at CF, but where should one write in? You're literally looking at a Google CAPTCHA, you can't go to the contact page because that's behind this proxy that won't let you pass.
- JakeTheAndroid 7y agoJGC is fairly popular on here and is CTO at Cloudflare. You can simply write into support@cloudflare.com, those tickets are forwarded to engineering teams.
- lucb1e 7y agoSupport options would be good info to put on that CAPTCHA page instead of having to find that somewhere deep down in an HN thread. Wasn't HN also behind CloudFlare? Looks like that changed, but maybe it will be again in the future.
- crypt1d 7y agoI suspect Cloudflare is doing some form of 'fingerprinting' to flag potential attacks. Fingerprinting is probably based on things like IP, user agent, js being enabled, etc. In this case it seems that Cloudflare only banned a specific user agent with js_enabled=no. Obviously this is all just an educated guess, since I've worked on building scrapers for cloudflare-protected websites.
- annoyingnoob 7y agoCame to say the same thing.... Try changing the user-agent the browser sends to match the user agent that Chrome sends.
- edf13 7y agoThere is a stage where "good" companies get so big that they can't really be "good" (For all)... Cloudfare has passed that point a while back. They have so many policies, departments, shareholders and government departments to please that it is now impossible for them to be a truly good force the open internet.
- hn_lurker1 7y agoI think the site went down. Here's the archive: http://archive.is/dVfYE http://archive.is/dVfYE
- dijit 7y agoIronically; Cloudflare would be quite useful for me right now. :)
- OrgNet 7y agoGoogle's Recaptcha is a much bigger problem then Cloudflare's service for me currently, but it could change at any time.
- big_chungus 7y agoReCaptcha is a necessary evil, but there's something that needs to change: the internet-wide rate limit. If I try to scrape a site and start getting captchas, when I go back and try to browse a completely different site, I'm suddenly trying to drag the points to outline a plane for ten minutes. Keep track of reputation on a site-specific basis.
- cronix 7y agoI've been noticing a larger and larger portion of sites in google results have been taken over by something. They all act the same way, and act similar to cloudfares checks. You get a big green dot on the screen first and then a bunch of redirects. I've not read anything about it, but probably 1/15 of my google result clicks end up there. How does google not know these sites have been taken over and keep them on the first page of search results? It's getting tiring because they also hijack your history, so you can't just hit "back" and you lose everything you've been searching through. You can't just click "back" to the results page and go to next result...you have to start search over and remember exact terms you used "that last search"
- BenjiWiebe 7y agoI have a little tip for you; right-click your back arrow, and choose your search page from the list.
- chance_state 7y agoAnother tip: block js globally(uBlock Origin) and white list sites you trust.
- htfu 7y agoAt least on iOS Safari there's this bug (feels like it's always been there, maybe content blocker related?) where sometimes a search simply gets eaten. The browser somehow thinks you went from nowhere straight to the page you're on, even though you went past a Google results page. I assume it's somehow redirect-related and that's why these sites tend to trigger it.
- why-oh-why 7y agoI’m thinking of two situations: - you tapped the “Siri suggestion” result which completely skips the SERP. I hate that “back” doesn’t bring you back to what I typed in the search/URL bar - I regularly visit The Verge, open a story and then the back button doesn’t take me to the homepage but to the page before it. I blame their crappy JavaScript but maybe we’re experiencing the same thing.
- sct202 7y agoRandom web hosts also have sloppy antibot 'AI's'. Siteground's is the most annoying because it for some reason thinks my work's network is a bot, and it doesn't identify itself unless you reverse image search their little anti-bot picture.
- xacky 7y agoThis is the death of alternative browsers it's only a matter of time before Firefox and friends gets blocked from major websites for "security" reasons and you will only be able to browse the internet in a browser that enforces full tracking and ads only. The MPAA and similar organizations is probably working on this already.
- phantom_oracle 7y agoCF appears to be looking at the UA-agent and deciding to block based on that. I'm guessing it's very basic checking because deep browser-fingerprinting is supposed to against the law in some countries (I stand to correction on this statement). I'm not personally a fan of CF because of the amount of data they can potentially obtain(or do), but there's a lot of crap out there and their firewall is robust enough to protect Johns Cowboy store from contributing to some dudes Monero mining botnet.
- gok 7y agoI really wish you could just directly pay for services. A hundredth of a cent per visit would make most abuse un-profitable while still allowing very affordable procrastination.
- algeoMA 7y agoI also hope this happens. It would be interesting too, if it was bidirectional (services paying you to use them. Payment for your data, essentially).
- awinter-py 7y ago(1) totally agree re money being an answer here, (2) not sure it solves DDOS mitigation, especially if you're giving away a free preview
- sneak 7y agoThis would make search engines impossible, sadly.
- z3t4 7y agoContrary, I think it would make search engines better!
- Dylan16807 7y agoWhy do you think that?
- perl4ever 7y agoPeople always say "why, why not micropayments"? Micropayments require even smaller transaction fees. Really small transaction fees require centralized regulation and economies of scale, i.e. government control and monopoly. You can't have your freedom and your frictionless markets both. The more anarchy, the more expensive buying and selling is, and the more business models and options for wealth creation simply can't work.
- Dylan16807 7y ago
- RyanK24 7y agoIt appears that you may have made some modifications to your user agent string. If you revert your user agent to the one provided by default by your browser vendor everything will be fine.
- dijit 7y agoIt appears that setting it to the same as Chromes does indeed work! for context this is what I had set (and, for quite some time it was working): "Mozilla/5.0 (X11; Linux x86_64; rv:57.0) Gecho/20100101 Firefox/57.0" Ironically I set this so that I could continue logging in to google. Since I had been unable to log in to google-apps without setting this user agent string. What did it fail on? the mis-spelling of "Gecho"?
- migueldemoura 7y agoThat User-Agent won't trigger the block page you were experiencing. No clue about the issues with Google, perhaps some feature detection going on?
- The-Compiler 7y agoNope, it's Google trying to ban "embedded browser frameworks" - see https://github.com/qutebrowser/qutebrowser/issues/5182 https://github.com/qutebrowser/qutebrowser/issues/5182 for details.
- GoblinSlayer 7y agoI used straight firefox and was still banned just fine. It didn't start in 2019 either. Chrome is their cash cow, if you don't use it, you're a liability.
- The-Compiler 7y agoI always recommend setting custom user-agents for a problematic page instead of setting them globally. For the Google issue, qutebrowser v1.9.0 does that already, see https://github.com/qutebrowser/qutebrowser/issues/5182 https://github.com/qutebrowser/qutebrowser/issues/5182
- open-source-ux 7y agoAlso related: depending on where in the world you reside, you may be more likely to encounter Cloudflare blocking sites or simply slowing the retrieval of websites (as it scrutinises traffic to those sites). This may be more likely to occur to you if you access the web outside of North America and Western Europe. CloudFlare is ruining the internet for me (2016) https://www.slashgeek.net/2016/05/17/cloudflare-is-ruining-the-internet-for-me/ https://www.slashgeek.net/2016/05/17/cloudflare-is-ruining-t... And the ensuing Hacker News discussion a few months ago: https://news.ycombinator.com/item?id=21169798 https://news.ycombinator.com/item?id=21169798
- calimac 7y agoMatthew the primary executive at Cloudflare behind the political and social weaponization of their product. The people at cloudlfare and the investors should be taught a lesson on mixing politics with business. Is their exposure to antitrust not Obvious?
- ycombonator 7y agoCloudflare is the new big brother.
- StavrosK 7y agoI don't see anyone here mentioning this, so I will. CloudFlare supports PrivacyPass, a third-party, privacy-preserving way to do proof-of-work for websites. Basically, you do some small amount of CPU work and get 30 tickets your browser can transparently redeem for access to a site. That's a pretty clever way to both deter bad actors and ensure legitimate users get uninterrupted access to websites.
- JohnFen 7y agoI probably don't understand PrivacyPass well enough, but I don't really see how it's a good solution to the problem.
- StavrosK 7y agoIt makes it so you solve thirty times fewer CAPTCHAs, which is not nothing.
- Ajedi32 7y agoAFAIK the Privacy Pass protocol has nothing to do with proof-of-work. It's just a way to allow users to solve a CAPTCHA once and re-use that single solution across multiple sites without jeopardizing privacy. Reduces the number of CAPTCHAs you see, but doesn't eliminate them entirely. What you're talking about is more like what Hashcash does, where it essentially replaces CAPTCHAs with a cryptocurrency miner, such that bots become more expensive to run due to the amount of energy they consume. The downside is it's not great for battery life for regular users either.
- KingMachiavelli 7y agoFYI, the new/current version Qutebrowser just added a built in list of websites that require a "Chrome/chromium" UA - it also added logic so that parts of the UA can be auto updated. Shameless shill: Qutebrowser is by far the best browser I've every used. The half measure of using addons (even powerful ones like Pentadactyl) cannot be compared to having a browser that is power user friendly in every aspect, from config to UI. If a site doesn't work well with it then I'm probably not going to use that site. If I can move away from Google then I can find your article/post somewhere else.
- dijit 7y agoThis mirrors my experience and opinions. However I miss certain powerful adblock features and I would prefer more/easy control over javascript that gets rendered since JS use is by far the largest consumer of energy on my laptop.
- dependenttypes 7y agoimo, they should have used the Chrome UA as a default for all sites. Leaking to sites what browser the user is using does not seem very privacy-respecting.
- therealmarv 7y agoWe need a website which tracks Cloudflare's captcha and blocking behaviour! I live in Cyprus (EU part!) and I witnessed more and more sites need now this stupid Captchas and I installed actually "Privacy Pass" which is also not working 100%. Why is this (EVIL!) company destroying my internet experience? This is a relatively new and recent experience for me... something has changed on Cloudflare's captcha requirements. Before that I've only witnessed this behaviour in countries like e.g. Philippines.
- Animats 7y agoSomewhat to my surprise, my SiteTruth system is allowed to read "bakadesuyo.com", the site with which the article author had a problem. Sitetruth uses a user-agent like "Sitetruth rating system", and makes no attempt to pretend to be a browser. Cloudflare let it through. No capcha. No error messages. Can't conclude much from this; Sitetruth has been reading sites openly for years in a well defined way from a well known IP address, examining them for ownership info about once a month. Although it looks at millions of sites, it never hits any one site very often. From Cloudflare's perspective, that's harmless.
- m463 7y agoThe root cause is hammering the site(s) with lots of traffic in a short period of time. Reloading the tabs looks like an attack. One solution might be to close tabs when you're done with them. (Althought I've been surprised to find that some people routinely keep many many many tabs open virtually forever)
- risyachka 7y agoSo basically the point of the article is this: there are no perfect tools. Not sure why this article got so much traction. It's like complaining that airport security checks your bags when you have gun-shaped objects inside it.
- dependenttypes 7y agoMore like asking why you are being kicked out of the airport when you have a bob hairstyle.
- Proven 7y agoOMG what a waste of time. I regret reading that crap