In 2007, I wrote some code to make Apache Nutch capable of crawling web pages protected with NTLM, Diget or Basic authentication schemes as well as crawling web

In 2007, I wrote some code to make Apache Nutch capable of crawling web pages protected with NTLM, Diget or Basic authentication schemes as well as crawling web pages via a proxy server that requires NTLM, Digest or Basic authentication ( https://issues.apache.org/jira/browse/NUTCH-559 https://issues.apache.org/jira/browse/NUTCH-559 ). This became first available with Apache Nutch 1.0. Although it was my second contribution to an existing open source project, it was my first contribution that added a new feature. As far as I know, this feature is still in use for crawling intranet web pages.