3 ms·

why is it assumed the web ought to be crawleable?

• NaturalPhallacy 5y ago
  So that we can find things on it without prior knowledge.
  • pas 5y ago
    You already get a lot of defaults from your vendor (OS, device, browser). Why couldn't these vendors maintain a bigger list of default entrypoints for the web? They already do for "apps". Plus there is already an endless sea of walled stuff (paywall, "create an account and login" wall, "fill in your address/ZIP code and we'll give you the best price" wall, government filtering wall). I'm not saying it's great, or it would be great, but currently having 1 (or maybe 1-and-half) search engines is also very far from ideal.