If I don't know how a webcrawler works, I would look at an programming language independent source like Wikipedia. After that I know what components I have to s

If I don't know how a webcrawler works, I would look at an programming language independent source like Wikipedia. After that I know what components I have to search for. For common lisp, the first thing I would search for is a HTTP Client and a HTML Parser. https://duckduckgo.com/?q=common+lisp+http+client https://duckduckgo.com/?q=common+lisp+http+client https://duckduckgo.com/?q=common+lisp+html+parsing https://duckduckgo.com/?q=common+lisp+html+parsing CLiki.net is always a good resource. If you've finished building a webcrawler, please create a website where you explain webcrawling for (common-)lisp. So the next one will not have the same problem :-)