3 ms·
Building more Amazon scraper websites. Working on a framework to minimize the effort of creating them, and currently testing to see if I can automate most of th
by generalizations 2y ago
Building more Amazon scraper websites. Working on a framework to minimize the effort of creating them, and currently testing to see if I can automate most of the process with Anthropic’s Sonnet.
The most recent site is https://computerdisplayprices.com https://computerdisplayprices.com
When I’m done, I’m probably going to make a blog post or two just talking through the automation I figured out so far. LLMs are amazing force multipliers.
- frankacter 2y agowhat toolset do you use for scraping? puppeteer?
- generalizations 2y agoNope, just selenium and pyautogui. The priority is to fly under the radar, rather than efficiency; for that I needed lower-level control. There's a bunch of other stuff I did to improve the anonymity, but to download I just open selenium at the url, wait for it to load, then use pyautogui to type 'ctrl-s' and type in the save directory.
- deleted 2y ago[deleted]