Not relevant at all. It was just shoehorned. The crux of a project such as this is maintaining a connection pool and managing it efficiently. Also respecting

Not relevant at all. It was just shoehorned. The crux of a project such as this is maintaining a connection pool and managing it efficiently. Also respecting robots.txt which the author barely mentions. This is a "tool looking for a problem" kind of post.