3 ms·
Shameless plug: Flyscrape[0] eliminates a lot of boilerplate code that is otherwise necessary when building a scraper from scratch, while still giving you the
by philippta 3y ago
Shameless plug:
Flyscrape[0] eliminates a lot of boilerplate code that is otherwise necessary when building a scraper from scratch, while still giving you the flexibility to extract data that perfectly fit your needs.
It comes as a single binary executable and runs small JavaScript files without having to deal with npm or node (or python).
You can have a collection of small and isolated scraping scripts, rather than full on node (or python) projects.
[0]: https://github.com/philippta/flyscrape https://github.com/philippta/flyscrape
- simonw 3y agoDoes Flyscrape execute JavaScript that is on the page (e.g. by running a headless browser) or is it just parsing HTML and using CSS selectors to extract code from a static DOM?
- philippta 3y agoAs of right now Flyscrape just parses HTML using CSS selectors from static DOM. But as more than enough websites there days are just an empty shell I am working on adding browser rendering support.