4 ms·

Anyone wrote a script yet that checks the top 1M (or so) web sites to find out which use Cloudflare? It would help with knowing what secrets I need to change (

Anyone wrote a script yet that checks the top 1M (or so) web sites to find out which use Cloudflare? It would help with knowing what secrets I need to change (as an end user -- I'm not a Cloudflare customer, thank $deity).

nikisweeting 10y ago
Yup, running it now. Results are being posted as fast as I can here: https://github.com/pirate/sites-using-cloudflare https://github.com/pirate/sites-using-cloudflare
- leoh 10y ago
  Looks cool, you have a lot of duplicates, though. $ cat sorted_unique_cf.txt | wc -l 7385121 $ cat sorted_unique_cf.txt | uniq |wc -l 4287625
  - nikisweeting 10y ago
    Apologies, fixing that now! I ran uniq before but piped it into the wrong file and ended up uploading the non unique version.
    - nikisweeting 10y ago
      Fixed: https://github.com/pirate/sites-using-cloudflare/raw/master/sorted_unique.zip https://github.com/pirate/sites-using-cloudflare/raw/master/...
sergiotapia 10y ago
Popular companies that use CloudFlare can be found here: https://stackshare.io/cloudflare/in-stacks https://stackshare.io/cloudflare/in-stacks
snug 10y ago
You don't even have to write a script, all that info is already out there.
- jlgaddis 10y ago
  I know I could find out by checking DNS, etc., but I'd rather not have to do that for every web site I use... and I'm guessing Cloudflare doesn't publish a list of every domain name that they serve.
  - chrisper 10y ago
    Maybe you can go backwards and see which websites resolve with these IPs: https://www.cloudflare.com/ips/ https://www.cloudflare.com/ips/
    - nikisweeting 10y ago
      Good idea, I'll try that next and add the results here: https://github.com/pirate/sites-using-cloudflare https://github.com/pirate/sites-using-cloudflare
pkcsecurity 10y ago
Not as epic, but I wrote a small node app that checks a list of URLs (made it to check my 1password sites, but it can be used on stuff in general). Not very sophisticated, just checks DNS and setCookie strings... https://github.com/weltan/cloudbleed-1password https://github.com/weltan/cloudbleed-1password

nikisweeting 10y ago

Yup, running it now. Results are being posted as fast as I can here: https://github.com/pirate/sites-using-cloudflare https://github.com/pirate/sites-using-cloudflare

leoh 10y ago
Looks cool, you have a lot of duplicates, though. $ cat sorted_unique_cf.txt | wc -l 7385121 $ cat sorted_unique_cf.txt | uniq |wc -l 4287625
- nikisweeting 10y ago
  Apologies, fixing that now! I ran uniq before but piped it into the wrong file and ended up uploading the non unique version.
  - nikisweeting 10y ago
    Fixed: https://github.com/pirate/sites-using-cloudflare/raw/master/sorted_unique.zip https://github.com/pirate/sites-using-cloudflare/raw/master/...

sergiotapia 10y ago

Popular companies that use CloudFlare can be found here: https://stackshare.io/cloudflare/in-stacks https://stackshare.io/cloudflare/in-stacks

snug 10y ago

You don't even have to write a script, all that info is already out there.

jlgaddis 10y ago
I know I could find out by checking DNS, etc., but I'd rather not have to do that for every web site I use... and I'm guessing Cloudflare doesn't publish a list of every domain name that they serve.
- chrisper 10y ago
  Maybe you can go backwards and see which websites resolve with these IPs: https://www.cloudflare.com/ips/ https://www.cloudflare.com/ips/
  - nikisweeting 10y ago
    Good idea, I'll try that next and add the results here: https://github.com/pirate/sites-using-cloudflare https://github.com/pirate/sites-using-cloudflare

pkcsecurity 10y ago

Not as epic, but I wrote a small node app that checks a list of URLs (made it to check my 1password sites, but it can be used on stuff in general). Not very sophisticated, just checks DNS and setCookie strings... https://github.com/weltan/cloudbleed-1password https://github.com/weltan/cloudbleed-1password