jpyles

4 ms·

1. 1.▲
   by jpyles 1y ago

   Luckily, I have some experience with playwright, so swapping shouldn't take me too long. Currently working on a PR to swap over
2. 2.▲
   by jpyles 1y ago

   With the custom headers, you can actually trick a lot of sites with bot protection to let you load their sites (even big sites like youtube, which I have found success in)
3. 3.▲
   by jpyles 1y ago

   I am quite aware, but I actually built most of the scraping logic a long time ago, before I even knew that playwright was a thing. I am looking to refactor a lot of this, and switching over to playwright is a high priority, using something
4. 4.▲
   Scraperr – A Self Hosted Webscraper(github.com)

   263 points by jpyles 1y ago|94 comments