3 ms·
More often than not I have an idea which site a result might be on when I issue a query: If I search for a news event it's a news site. If I search an error m
by ma2rten 5y ago
More often than not I have an idea which site a result might be on when I issue a query:
If I search for a news event it's a news site.
If I search an error message, I know the result is going to likely be stackoverflow, github issues or the forum of the library.
etc.
I don't think this strategy will get you all the way there, but it could be combined with other ways of curating sites to crawl.