4 ms·
How did you build this? Are you indexing the entire web yourself? Or are you using Google's index/removing the top 1 million based on domain?
by felixchan 14y ago
How did you build this? Are you indexing the entire web yourself? Or are you using Google's index/removing the top 1 million based on domain?
- wildmXranat 14y agoI think search APIs like Yahoo BOSS allow you pass arguments that contain a black list of domains. I think it's the 'sites' argument that may be used like this: &sites=-google.com
- taxonomyman 14y agoYou are right, but they won't allow the list to be 1 million sites long. You are talking 15 megs of data per data in plain text per request. But I like the idea of being able for users to, via a setting perhaps, add their own list of deny/include sites. Thx for the comment.
- shurane 14y agoIsn't this under Blekko's domain of ideas with the slashtags letting you include particular sites?