Because their crawler gets special privileges from cloudflare and the other CDNs. Here, read about the problem from one of the very few remaining non-GoogleBin

Because their crawler gets special privileges from cloudflare and the other CDNs. Here, read about the problem from one of the very few remaining non-GoogleBingYandex crawlers remaining: https://www.gigablast.com/blog.html#willneverhappen https://www.gigablast.com/blog.html#willneverhappen https://www.gigablast.com/blog.html#stopevilcensorship https://www.gigablast.com/blog.html#stopevilcensorship