5 ms·
Search engines are really a relic from back when everyone had their own webpage. Now everyone posts their content on a handful* of sites - Medium, Reddit, Stack
by phendrenad2 7y ago
Search engines are really a relic from back when everyone had their own webpage. Now everyone posts their content on a handful* of sites - Medium, Reddit, StackOverflow. I think what we need is an inversion of the search engine model... instead of a web crawler scouring the web for new pages, these handful of companies (Medium, Reddit, thousands more) should register with the search engines and push sitemaps regularly. This is the only way to level the playing field with Google, since the internet is so vast now that only Google/Microsoft/Yandex can afford the server/bandwidth fees to crawl it.
*- and by "handful" I mean tens of thousands of sites, which is relatively small.
- saagarjha 7y ago> Now everyone posts their content on a handful of sites - Medium, Reddit, StackOverflow. They do not and it would be a sad day if they did. Please don’t help push us towards that any further.
- buboard 7y agoThey do though. Old content will just gradually disappear into webarchive. Let's not pretend it didnt happen. (oh and btw we will probably change that again, but the content won't go into webpages-hosted-somewhere but probably will be served directly from the user's phne)
- Avamander 7y agoOnly if it's common knowledge. I've legit started to add "blog" to my searches to find more obscure knowledge.
- dragonwriter 7y ago> Search engines are really a relic from back when everyone had their own webpage. Now everyone posts their content on a handful of sites but: > since the internet is so vast now that only Google/Microsoft/Yandex can afford the server/bandwidth fees to crawl it. Is it a vast space that search engines need to crawl, or are there only a handful of sites that matter?
- phendrenad2 7y agoThere are a handful of vast sites that matter.