4 ms·
I'd like to write a small scraper for a website that uses NTLM authentication, the headers it sends are: HTTP/1.1 401 Unauthorized Server: Microsoft-II
by thomasahle 10y ago
I'd like to write a small scraper for a website that uses NTLM authentication, the headers it sends are:
HTTP/1.1 401 Unauthorized
Server: Microsoft-IIS/8.5
WWW-Authenticate: NTLM
WWW-Authenticate: Negotiate
...
Does RoboBrowser support these kinds of protocols? I tried to get it to work with Scrapy, but it seemed non-trivial...
- kej 10y agoIt's been years since I've used it, but I think cntlm can do this. Point your Scrapy code at the cntlm instance, and it should handle all of the NTLM headers for you.