2 ms·
I scrape lots of data from services while logged in. Scraping is done with curl, but every so often cookies expire, so I use selenium to login, save cookies, th
by ikeboy 8y ago
I scrape lots of data from services while logged in. Scraping is done with curl, but every so often cookies expire, so I use selenium to login, save cookies, then go back to curl.
- smallbigfish 8y agoIsn't curl fit to also do the login part and save the cookies?
- ikeboy 8y agoTons of stuff get loaded during login, hard to go through each one and code the proper urls and POST params etc, quicker to write login code.