3 ms·

Ask HN: How to unblock RSS feeds on Cloudflare hosted sites?

34 points by rishikeshs 2y ago

My blog[1] is hosted on Cloudflare pages. Fee of my readers complained that they’re unable to add my blog in multiple rss readers. Any ideas to bypass this ? [1] https://rishikeshs.com

_kyran 2y ago
Use a page rule for the URL pattern of the RSS feeds, and set the bot protection to off.
- kevincox 2y ago
  Exactly this. You want to turn off bot blocking on all endpoints that are intended to be used by bots. Really you should probably turn it off for just about everything on your site unless you are worried about scraping.
- jsheard 2y ago
  I wonder why CF doesn't disable bot protection on RSS feeds by default. They're supposed to be readable by bots, that's the whole point!
  - KETHERCORTEX 2y ago
    I guess they don't really care that much to implement all the possible exceptions.
- rishikeshs 2y ago
  I can’t find an option for turning bot protection off in the drop down. Does turning off browser integration works?
Beijinger 2y ago
Do yourself a favor and don't use cloudflare: https://expatcircle.com/cms/why-you-should-never-use-cloudflare-it-causes-problems-is-bad-for-seo-and-a-spyware-tool/ https://expatcircle.com/cms/why-you-should-never-use-cloudfl... I am currently thinking about signing up to https://politepol.com/en/prices https://politepol.com/en/prices It can circumvent the Cloudflare blockage of some blogs where I want to subscribe to the RSS feed. Clownflare is the cancer of the internet. Worse, even if you don't use it, some wordpress plug-ins seem to use it. You can see if you use the no-script extension. I just threw out a plug-in that I found always suspicious. I think it may have been one cause why my pictures did not index well on google. It seemed to use alicdn without even bother to mention this. WTF?
- chomp 2y ago
  So many inaccuracies in that article, I don’t know why you bothered linking it. You could have just made the privacy/single point of failure/web monoculture argument and tossed the rest.
  - deleted 2y ago
    [deleted]
  - Beijinger 2y ago
    This is just another one. What are the inaccuracies? I wonder if there is registrar that uses Cloudflare. This would be the ultimate point of failure. Yes, some problems can be solved, e.g. the non-indexing of pictures. But this requires a paid account. Face it. Most people use it as a cheapo CDN. And it is just not worth it. Many plug-ins are incompatible with cloudflare, e.g. Multisite. You will basically start building your site around cloudflare.
  - KomoD 2y ago
    > I don’t know why you bothered linking it. Because it's their article and they try to get people to use their BunnyCDN affiliate link instead.
badlibrarian 2y ago
65 days ago: "My email is jgc@cloudflare.com. I'd like to hear from the owners of RSS readers directly on what they are experiencing. Going to ask team to take a closer look." Nothing happened? https://news.ycombinator.com/item?id=41864632 https://news.ycombinator.com/item?id=41864632
- pointlessone 2y ago
  Nothing whatsoever. The feeds that failed to fetch in my Miniflux at the time are still failing. If anything a few more feeds joined them with the same symptoms.
- blitzar 2y ago
  The team took a look. Working as intended (tm).
chuanliang 2y ago
https://yeeach.com/389/ https://yeeach.com/389/ I configure following the steps of this post and it works for me. It was written in Chinese, so I just translated it to English. Login to your Cloudflare dashboard->Your domain Your feed is https://example.com/feed https://example.com/feed in there # Method 1. By WAF rule 1. Security->Bots Enable Bot Fight Mode Disable Block AI Bots 2.Security->WAF->Create rule https://imgur.com/a/5dtgsQP https://imgur.com/a/5dtgsQP # Method 2. By page Rules just disable the security Rules->Page Rules->Create Page Rule URL(required ) example.com/feed Then the settings are: Disable Security
ghjfrdghibt 2y ago
All the issues I experience on the internet are related to cloudflare. Only way around them appears to be: don't use Firefox, allow all tracking and ads. Any site that throws cloudflare shit up infront of me before I either can get to the site or use a service are immediately discarded as a useless site.

34 points by rishikeshs 2y ago

My blog[1] is hosted on Cloudflare pages. Fee of my readers complained that they’re unable to add my blog in multiple rss readers. Any ideas to bypass this ? [1] https://rishikeshs.com

_kyran 2y ago

Use a page rule for the URL pattern of the RSS feeds, and set the bot protection to off.

kevincox 2y ago
Exactly this. You want to turn off bot blocking on all endpoints that are intended to be used by bots. Really you should probably turn it off for just about everything on your site unless you are worried about scraping.
jsheard 2y ago
I wonder why CF doesn't disable bot protection on RSS feeds by default. They're supposed to be readable by bots, that's the whole point!
- KETHERCORTEX 2y ago
  I guess they don't really care that much to implement all the possible exceptions.
rishikeshs 2y ago
I can’t find an option for turning bot protection off in the drop down. Does turning off browser integration works?

Beijinger 2y ago

Do yourself a favor and don't use cloudflare: https://expatcircle.com/cms/why-you-should-never-use-cloudflare-it-causes-problems-is-bad-for-seo-and-a-spyware-tool/ https://expatcircle.com/cms/why-you-should-never-use-cloudfl... I am currently thinking about signing up to https://politepol.com/en/prices https://politepol.com/en/prices It can circumvent the Cloudflare blockage of some blogs where I want to subscribe to the RSS feed. Clownflare is the cancer of the internet. Worse, even if you don't use it, some wordpress plug-ins seem to use it. You can see if you use the no-script extension. I just threw out a plug-in that I found always suspicious. I think it may have been one cause why my pictures did not index well on google. It seemed to use alicdn without even bother to mention this. WTF?

chomp 2y ago
So many inaccuracies in that article, I don’t know why you bothered linking it. You could have just made the privacy/single point of failure/web monoculture argument and tossed the rest.
- deleted 2y ago
  [deleted]
- Beijinger 2y ago
  This is just another one. What are the inaccuracies? I wonder if there is registrar that uses Cloudflare. This would be the ultimate point of failure. Yes, some problems can be solved, e.g. the non-indexing of pictures. But this requires a paid account. Face it. Most people use it as a cheapo CDN. And it is just not worth it. Many plug-ins are incompatible with cloudflare, e.g. Multisite. You will basically start building your site around cloudflare.
- KomoD 2y ago
  > I don’t know why you bothered linking it. Because it's their article and they try to get people to use their BunnyCDN affiliate link instead.

badlibrarian 2y ago

65 days ago: "My email is jgc@cloudflare.com. I'd like to hear from the owners of RSS readers directly on what they are experiencing. Going to ask team to take a closer look." Nothing happened? https://news.ycombinator.com/item?id=41864632 https://news.ycombinator.com/item?id=41864632

pointlessone 2y ago
Nothing whatsoever. The feeds that failed to fetch in my Miniflux at the time are still failing. If anything a few more feeds joined them with the same symptoms.
blitzar 2y ago
The team took a look. Working as intended (tm).

chuanliang 2y ago

https://yeeach.com/389/ https://yeeach.com/389/ I configure following the steps of this post and it works for me. It was written in Chinese, so I just translated it to English. Login to your Cloudflare dashboard->Your domain Your feed is https://example.com/feed https://example.com/feed in there # Method 1. By WAF rule 1. Security->Bots Enable Bot Fight Mode Disable Block AI Bots 2.Security->WAF->Create rule https://imgur.com/a/5dtgsQP https://imgur.com/a/5dtgsQP # Method 2. By page Rules just disable the security Rules->Page Rules->Create Page Rule URL(required ) example.com/feed Then the settings are: Disable Security

ghjfrdghibt 2y ago

All the issues I experience on the internet are related to cloudflare. Only way around them appears to be: don't use Firefox, allow all tracking and ads. Any site that throws cloudflare shit up infront of me before I either can get to the site or use a service are immediately discarded as a useless site.