3 ms·
Came across similar situations before [beyond previous issues with being a trusted bot by Cloudflare] The destination website user was wondering why our servic
by ricardo81 4y ago
Came across similar situations before [beyond previous issues with being a trusted bot by Cloudflare]
The destination website user was wondering why our service didn't visit their website and why we were receiving 503s in return, with CF in the middle. Turns out in this case it was an additional bot blocking service they'd installed on their own server, which I'd presume is hard for them to debug if the request never reaches them (but in this case it did, just added confusion for them).
Far from ideal to have a middle man arbitrate a web request or decide what is trusted. On the flip side, lots of rogue traffic that should be blocked. Think in some cases the WAFs are just a bit too aggressive with the grey area and UAs they don't know. It creates a barrier of entry to new players.