I wrote my own little search engine years ago. It's pretty simple: You crawl a website and search for all links, then you crawl all the links from these linked

I wrote my own little search engine years ago. It's pretty simple: You crawl a website and search for all links, then you crawl all the links from these linked websites and so on. You can still see some of my code here: https://github.com/Wronnay/search-lib https://github.com/Wronnay/search-lib