4 ms·

Yes, I possess web scraping abilities and a decent scripting ability in Python :-) What does it bring me? Tickles. Joy that I wasted the time and money of some

Yes, I possess web scraping abilities and a decent scripting ability in Python :-) What does it bring me? Tickles. Joy that I wasted the time and money of somebody who paid for it. Fun time scripting in Python and who knows, some ideas might come out of it. The last I touched selenium was when I was at grad school a decade ago. Is that still the way to go?! I was hoping the art would have grown leaps and bounds by now. Is there any way to automate user actions on existing browser window.. as in - injecting mouse and keyboard inputs on my already open (and logged in) Firefox tab to say procedurally click on all emails in my inbox.. ?

theGeatZhopa 4y ago
It's being a while for me, too. I remember, there was some add-on for Firefox, which can be used with python to automate actions. It was some test suite framework for web testing. But, having done a quick Google search, didn't find it again. On the other side.. when using selenium with a f.e. Firefox driver, it is possible to fire up an instance and use it like ordinary Browser doing logins and whatever. While being on webpages in question, it's possible to run python and interactively automate things on that very site. It's already loaded, so it's possible to interact with it. 1. Fire up an instance 2. Login to Amazon 3. Have a script doing searches with arbitrary Keywords on the fly / and/ or scrap the information needed. That's what I did with stocks. I login into the service providers and let the script do the searches for the stocks, scraping the data, save it into db. If you leave that scraping data out, then you'll have a webrobot :) Nice Project btw.. "just sh*t into someone's soup making a beautifulsoup" :)