3 ms·
>Google and Bing index web pages, but there are so many alternative forms of curated information we've created over the last decade and a lot of that informatio
by mrkramer 4y ago
>Google and Bing index web pages, but there are so many alternative forms of curated information we've created over the last decade and a lot of that information is in semi-public spaces like slack, discord, whatsapp, telegram, facebook groups, newsletters etc.
That's called Deep Web("semi-public spaces like slack, discord, whatsapp, telegram, facebook groups, newsletters etc.") and you can't crawl and index it unless you partner with them and they allow you to do it.
But the biggest question that keeps haunting me is Does the world need another internet search engine? Casual users just don't care if your new internet search engine is 10 or 20% better than Google, what I'm trying to say it needs to be something totally different and significantly better in order to catch the attention and the engagement of the users.
- ianbutler 4y agoSo to the question of does the world need another search engine? I mean I think the fact that so many people think yes enough to both create new search engines and in some cases fund them, especially when google for a lot of people myself included really doesn't produce useful results outside of basic questions, is yes. It also makes more sense if users aren't the product and you can have a business doing 10's-100's of millions in revenue based on serving some niche without having the be exploitative via subscription or some b2b offering you make. Google is so big it's almost a certainly they are more than suboptimal at a profitable enough niche. DuckDuckGo proved that with it's focus on privacy which is most certainly a niche and the 100million in revenue they do. Personally I think there's a lot of B2B opportunity for a lot of this information where the search can be a multi billion dollar business just not on the backs of consumers.