2 ms·My search engine crawls its own results. The downside is the index is very tiny, under 100,000 pages.by ronsor 10y agoMy search engine crawls its own results. The downside is the index is very tiny, under 100,000 pages.