4 ms·
Are there any existing or developing solutions for visual web scraping? It feels like the only way to capture data from emerging WEI and canvas-powered websites
by xnx 3y ago
Are there any existing or developing solutions for visual web scraping? It feels like the only way to capture data from emerging WEI and canvas-powered websites will soon be screen readers designed for accessibility and automated GUI interaction.
- tepitoperrito 3y agoYou could also explore approaches like what puppeteer-heap-snapshot does and extract the data you're interested in from the in memory Javascript objects that the canvas powered website uses to generate its contents.
- djsegal 3y agoYou mean something like octoparse.com or serpapi.com?
- remmargorp64 3y agooctoparse extracts data from DOM elements. It can't OCR or visually process a dynamic page. The page has to have a structured and predictable HTML DOM. Unless I'm missing something? And serpapi is just for google searches?
- datadrivenangel 3y agoOptical Character Recognition unfortunately.
- matheusmoreira 3y ago> canvas-powered websites Is this really happening right now? Are people really rendering their entire websites into an opaque canvas? Decades of moving the web platform forward and it has come to this?
- flashback2199 3y agoIf it's a flutter web app, yes. Reminds me of flash, kinda
- xnx 3y agoRare, but I was curious to know what the state of the art was. It's kind of like the "analog hole" in audio and video recording.
- survirtual 3y agoMakes sense to me. Decades of bloated, backwards-compatible hacks in CSS, HTML, and Javascript makes a purpose-built, clean, bloat-free UI system feels pretty good actually. This is what happens when you move the web "forward" for advertisers and exploitive data brokers instead of users.
- matheusmoreira 3y agoPutting everything inside a canvas is exactly what advertisers and data brokers want. It basically turns your browser into a television. It destroys structure which significantly complicates ad blocking. Might also be illegal due to accessibility laws.
- omneity 3y agoYou're probably looking for RPA / Surface automation solutions. This used to be all the rage a few years back, supporting various "digital transformation" initiatives in large Enterprise. UIPath [0] is a main contender in this space. [0]: https://www.uipath.com/ https://www.uipath.com/
- remmargorp64 3y agoUIPath doesn't have a visual web scraping module or automation, from what I have seen. You might be able to build a custom one and execute it with their orchestration/automation tools, but I don't see that any support for that out of the box?
- omneity 3y agoUIPath[0] and many others do. It's actually super common, both needed to support desktop apps built using custom UI toolkits (from memory, xaml and others actually give you something DOM-like to hook into, but others like javafx don't) and it's also useful since a lot of enterprise software runs within VDI/VNC/... so all you have (at a low level) is a "screenshot" and the ability to click on coordinates or trigger keyboard events. [1] is what surface automation looks like in practice. [0]: https://www.uipath.com/product/ai-computer-vision-for-rpa https://www.uipath.com/product/ai-computer-vision-for-rpa [1]: https://images.ctfassets.net/5965pury2lcm/4hwXQpRTQkIIAy2q8kwZP6/3f07524c88cb13f683f3bc976f9a608d/UiPath-AI-Computer-Vision-snapshot.png https://images.ctfassets.net/5965pury2lcm/4hwXQpRTQkIIAy2q8k...
- geekodour 3y agorelated: https://news.ycombinator.com/item?id=38200308 https://news.ycombinator.com/item?id=38200308