3 ms·
Yes, and even with paywalls, as long as the source has login details it can still be done (although this would probably be illegal). Anecdotal evidence: I work
by lgl 6y ago
Yes, and even with paywalls, as long as the source has login details it can still be done (although this would probably be illegal).
Anecdotal evidence: I work in a tour operator and we publish our products on tripadvisor and getyourguide which are two very popular places to advertise these products and that provide an extranet to suppliers where they can login to create and manage products, availability, etc. A few years ago before they had developed APIs or had only private APIs for the "big guys" and wouldn't really pay any attention to small shops' requests, I managed to use Puppeteer [0] [1] (a node.js library to manage headless Chrome) to dynamically update our products into their extranet. It's very powerful and with some tinkering you can automate pretty much any behavior, including authentication and xhr interactions inside their platform (although this will require a bit of studying their requests using the browsers developer tools).
It's a great tool.
[0] https://github.com/puppeteer/puppeteer https://github.com/puppeteer/puppeteer
[1] https://pptr.dev https://pptr.dev