4 ms·
Are scrapers written on a per-website basis? Are there techniques to separate content from menus / ads / filler / additional information, etc? How do people dea
by givemeethekeys 3y ago
Are scrapers written on a per-website basis? Are there techniques to separate content from menus / ads / filler / additional information, etc? How do people deal with design changes - is it by rewriting the scraper whenever this happens? Thanks!
- staticautomatic 3y agoYeah it’s often gonna be a per site, lots of xpath queries, email me when it breaks kind of endeavor.
- spaniard89277 3y agoYeah. I managed to abstract a bit the structure but in the end websites change.