3 ms·
A lot of the time when I'm writing a scraper it's because of bad/old code or incorrect HTML. So if Kimono has issues with that its utility is reduced.
by voltagex_ 13y ago
A lot of the time when I'm writing a scraper it's because of bad/old code or incorrect HTML. So if Kimono has issues with that its utility is reduced.
- pranade 13y agoKimono can handle several pages with malformed and old/bad HTML. We're still in beta though, so we're handling more edge cases as we encounter them. Should work on HN main page.
- voltagex_ 13y agoSounds good. I've made a note of it for the next time I need to screen scrape something.
- tlarkworthy 13y agoI developed some hot strategies for the next level ... http://edinburghhacklab.com/2013/09/probabalistic-scraping-of-plain-text-tables/ http://edinburghhacklab.com/2013/09/probabalistic-scraping-o...
- Nilzor 13y agoHave you thought of implementing a system for custom handling of edge cases? Realistically you can't handle all edge cases, so leaving the last 2% up to the user (which is a developer) would be a good idea. It'd still save him 98% of the work, but also give him the comfort of knowing it won't break even if site X is doing something weird with their HTML in the future. I'll leave it to you to figure out how one would implement such a feature ;-)