3 ms·
I can do everything listed in benefits with puppeteer, while I can’t even make sense of what iframe is supposed to achieve here, or how it’s even gonna load (an
by oefrha 7y ago
I can do everything listed in benefits with puppeteer, while I can’t even make sense of what iframe is supposed to achieve here, or how it’s even gonna load (anyone with a shred of sense would set X-Frame-Options to SAMEORIGIN, subject to exceptions). The airovic.com site doesn’t work and hilariously attempts to load two seemingly important scripts from localhost...
I’m very confused about this submission, and even more confused about how it managed to almost top the front page.
Edit: Having read the code samples, it seems the code snippets are supposed be run from the same origin in the dev console. A quick and dirty way to interactively scrape without navigation, I guess? Still not sure what the “all together: Airovic.com” is supposed to mean, and definitely more limited than puppeteer.
Edit2: To be fair to the author, they did say
> You cannot bypass their protections without using a HTTP Tunneling component.
Which I didn’t see until just now. This is a pretty big caveat though, should probably be more upfront...
- javajosh 7y agoHe's traversing the site using the injected iframe. That is, there is no top-level navigation event, only an iframe navigation event. Then he's gathering information from the iframe hosted DOM and combining it in the context of the starting, main page. I think it's kinda clever.
- oefrha 7y agoOkay, I guess the scripts are supposed to run in the same origin, not from some third party, say airovic.com. I edited my original post. It’s still more limited than puppeteer though.
- amelius 7y agoInjecting an iframe into websites could trigger an assertion error, because the iframe isn't supposed to be there.
- natzar 7y agoHi, that's right. Some sites protect html injection. Twitter protects their site very well, but if you use http tunneling they can't do nothing as you can modify X- headers.
- stockkid 7y agoInteresting, could you explain what you mean by http tunneling and how it can bypass protection against html injection?
- natzar 7y agoHi! I'm the submitter. I just submitted the article to recieve some feedback. I was working a lot on the tool and the article, but needed to check if I was into something. I fixed the errors already. it is woking.