4 ms·
At the minimum, a nationalized web index would be fantastic (modulo the normal concerns above government censorship that already apply). It would reduce so much
by ForHackernews 7y ago
At the minimum, a nationalized web index would be fantastic (modulo the normal concerns above government censorship that already apply). It would reduce so much duplicated effort if there were a standard government crawler that indexed the web and made that data available to anyone who wanted to use it.
Similar to the way weather data is collected by the government, and multiple private companies use it to produce their own sites and forecasts, you could have different search engines doing different interesting things with the data: compete on UX, or focus on particular niches of search.
As it stands today, we have a Bing-Google duopoly because indexing the whole web is such a massive undertaking.