Guido van Rossum, the creator of Python, co-wrote a web crawler in under 500 lines: https://github.com/aosabook/500lines/tree/master/crawler https://github.com/

Guido van Rossum, the creator of Python, co-wrote a web crawler in under 500 lines: https://github.com/aosabook/500lines/tree/master/crawler https://github.com/aosabook/500lines/tree/master/crawler It's especially interesting because it takes advantage of new Python features like asyncio.