3 ms·
Clearly Cloudflare isn't responsible for the data centralization that is corrupting the internet. They are however, a very sophisticated and efficient enforcer
by clukic 5y ago
Clearly Cloudflare isn't responsible for the data centralization that is corrupting the internet. They are however, a very sophisticated and efficient enforcer of those policies. They've helped ensure large portions of the web is no longer crawlable, and that serves to consolidate information and power in those tech monopolies.
- WORMS_EAT_WORMS 5y agoAka, SMB's now have access to the same tools the tech monopolies do. GDPR-like policies will continue to flood as governments partition their Internets and data making it harder and harder to run international Internet businesses. I'm not particularly happy about things either (especially crawling access), but it will be a net positive whenever you can level the playing field with competition. When the biggest infringers of data are driving the creation of government policies that only they can circumvent and navigate -- that's a serious, serious problem.
- fierro 5y agowhy is it assumed the web ought to be crawleable?
- NaturalPhallacy 5y agoSo that we can find things on it without prior knowledge.
- pas 5y agoYou already get a lot of defaults from your vendor (OS, device, browser). Why couldn't these vendors maintain a bigger list of default entrypoints for the web? They already do for "apps". Plus there is already an endless sea of walled stuff (paywall, "create an account and login" wall, "fill in your address/ZIP code and we'll give you the best price" wall, government filtering wall). I'm not saying it's great, or it would be great, but currently having 1 (or maybe 1-and-half) search engines is also very far from ideal.