I think skip crawling the internet and do just the "personal search engine" thing, and then merge with bing-api or something. Otherwise, have you really though

I think skip crawling the internet and do just the "personal search engine" thing, and then merge with bing-api or something. Otherwise, have you really thought how'd you do distributed crawler & storage/cpu/ram/bandwidth for it ? What will you be using for search-engine ?