4 ms·
I am talking internally with the customer support team about what happened to this customer's traffic. It is definitively not the case that doing "four requests
by jgrahamc 6y ago
I am talking internally with the customer support team about what happened to this customer's traffic. It is definitively not the case that doing "four requests per minute" gets you rate limited.
- dinedal 6y agoRegardless of the reason being the limit or not - are these limits published anywhere? It doesn’t appear to be the case.
- bratao 6y agoThere is a connection limit???
- capableweb 6y agoA great first step would be to take responsibility for what the customer has proven to happen. "It is definitively not the case that doing" is directly at odds with what the author provides, you might want to reframe your message to "it shouldn't be like this but unfortunately it is like this right now, sorry" rather than dismissing the author with that they are not correct.
- Jamie9912 6y agoYou shouldn't assume that he is correct either; i'm a free plan user and have never experienced this
- pawurb 6y agoIf you're on free plan you have no way to know if this has happened to your website.
- avereveard 6y ago> no way you can (and should) put monitors on the outside of your infrastructure as well as inside. I've multiples hitting the login page and robots file where I work, and never got an unaccounted 503
- pawurb 6y agoLike I wrote, for some integrations it is not possible to gather all the logs. Also how will you know that a client accessing your website in a browser gets 503 instead of your web page?
- avereveard 6y agoYou don't, but your monitors will show the 503 happening, how often, on which endpoint operation and in which regions; that will give you a pretty good picture of whether is actually your CDN layer or something else triggering the 503
- buisi 6y agoWhat if it's a specific browser with a specific TLS stack, or something weird?
- avereveard 6y agowhat if it's green lizard man chewing cables? one has to start somewhere reasonable and realistic first.
- herendin2 6y agoBut, I thought in your case you did know something was wrong: client complained and you saw 503 errors?
- jgrahamc 6y agoI am taking responsibility for what the customer is reporting here.
- Kudos 6y agoI think they are taking your use of "would" literally, and not reading it as an implied "should".
- oji0hub 6y agoProven is a strong word and rate limiting is not the only possible explanation. Something is happening and we don't know what.
- deleted 6y ago[deleted]
- codetrotter 6y agoWhile we are on the subject of rate limiting and such, does Cloudflare allow using its service for serving video files for a media heavy social media app where we store the videos on Backblaze B2? I’m working on such an app, and am hoping to use Cloudflare + Backblaze B2, because of the bandwidth alliance. https://www.cloudflare.com/en-gb/bandwidth-alliance/ https://www.cloudflare.com/en-gb/bandwidth-alliance/ However, the Terms of Service say: > 2.8 Limitation on Serving Non-HTML Content > The Services are offered primarily as a platform to cache and serve web pages and websites. Unless explicitly included as part of a Paid Service purchased by you, you agree to use the Services solely for the purpose of (i) serving web pages as viewed through a web browser or other functionally equivalent applications, including rendering Hypertext Markup Language (HTML) or other functional equivalents, and (ii) serving web APIs subject to the restrictions set forth in this Section 2.8. Use of the Services for serving video or a disproportionate percentage of pictures, audio files, or other non-HTML content is prohibited, unless purchased separately as part of a Paid Service or expressly allowed under our Supplemental Terms for a specific Service. If we determine you have breached this Section 2.8, we may immediately suspend or restrict your use of the Services, or limit End User access to certain of your resources through the Services. https://www.cloudflare.com/en-gb/terms/ https://www.cloudflare.com/en-gb/terms/ And I am wondering what kind of subscription would be appropriate for my use-case if any, that would allow me to host the files on Backblaze B2, and serve these files through Cloudflare. (Cloudflare would also be hosting our API, so it’s not just video files that we want to serve via Cloudflare.)
- Sayrus 6y agoFor what is is worth, I've been using their Free Tier to serve over 10k requests per hour with ~60% html / ~40% media (mainly pictures, very few videos) and I've never had a problem. However, for a CDN for video content YMMV. Perhaps you should try contacting them directly to have a written estimate.
- tmikaeld 6y agoThey do NOT allow video or large files (+50MB) on the Free plan or even on the paid plans! You'll have to get an Enterprise account for that (it's no longer starting at $5K/mo, you can get custom accounts setup to match your needs).
- philip1209 6y agoIs it possible that this person's free-plan traffic was routed through a POP that was under attack? Then, upon upgrading to Pro the routing rules for the account were modified to avoid under-attack data centers.
- jwr 6y agoI think it might also be worth considering whether returning 503 is the right response when rate limited. 5xx indicates server failure, a "429 Rate Limited" is a more appropriate response.
- oji0hub 6y agoIf it is indeed an issue of rate limiting.
- pdpi 6y ago4xx is a client error and 429 indicates that particular client is making too many requests. 5xx is a server error and 503 says the service itself is unavailable irrespective of the client’s actions. In this particular case it’d be unavailable for contractual rather than technical reasons, but it’s still the right status
- goatcode 6y agoPlease keep us posted. From a naive perspective, what happened has a flavor of "protection fees." A detailed explanation would help quickly dispel this perspective.
- jgrahamc 6y agoIt's going to be hard for me to keep you posted because it would mean discussing a customer's account and I can't do that. That's confidential.
- dmortin 6y agoWhy don't you send an email to the customer if there is an error while serving content by cloudflare? It can be a daily digest of the errors of the day. If the problem is on cloudflare's side then the cloudflare user doesn't even know about it if it's an intermittent error.
- Abishek_Muthian 6y agoMy application[1] with similar rpm as OP received 503 status last month for about an hour first time in 1.5 years, I assumed it to be an one-off issue at CF end. It happened while I was using it and so I'm now concerned if it's a regular affair for my users, most of whom are not from my geographical location(data-center). I'm a free plan user because my application is not monetized and obviously would switch to paid plan once it starts generating money. CF free plan has been indispensable for many such free projects. UptimeRobot(Free) doesn't show anything fishy, except for CF error 521 occasionally. Again UptimeRobot requires paid version to check for HTTP status message, guess I'll have to do it or setup a self hosted(recommendations?) solution to monitor HTTP status of CF Free application. If CF does perform rate limiting for such low rpm, I would prefer to be intimated as even third rate shared hosting providers do it and I hope CF wouldn't put their reputation on the line for something like this. [1]https://needgap.com https://needgap.com
- jgrahamc 6y agoTalk to support.
- pdimitar 6y agoI understand you can't share a customer's account details. But can we at least get an update if this is the intended behaviour of the CF free plan accounts (so people know to upgrade) or is it an one-off incident?
- jgrahamc 6y agoAs I said above, this is not someone hitting a rate limit.
- plasma 6y agoI’d look into idle connection handling, I’ve had problems in the past with cloudflare and it’s long open sockets to origin being quietly closed at origin, breaking requests to cloudflare.