3 ms·
Neat trick! I took a look and the page is about 4MB or maybe 8MB, less than 1MB compressed. Smaller than the typical animated ad. Is there an actual index data
by NelsonMinar 5y ago
Neat trick! I took a look and the page is about 4MB or maybe 8MB, less than 1MB compressed. Smaller than the typical animated ad.
Is there an actual index data structure? What I see on the page is just a bunch of simple <a> links that are linearly scanned. Nothing wrong with that mind you, it seems to work well.
- westcort 5y agoIt’s just simple keyword matching in the order of appearance on the list. I did something similar with the DMOZ directory: https://www.locserendipity.com/DMOZ.html https://www.locserendipity.com/DMOZ.html Also, as an experiment, I developed an auto-summarizer, scraped and summarized all of the edu domains on DMOZ, pared the non-active ones, and the ordered them by the amount of content (more content ranks higher). The result is this search engine: https://www.locserendipity.com/edu.html https://www.locserendipity.com/edu.html