3 ms·
HTML 5 has the 'article' tag. There's also header, footer, and other semantic mark-up tags. I've spent the last month writing scrapers for newspaper sites. No
by semanticist 16y ago
HTML 5 has the 'article' tag. There's also header, footer, and other semantic mark-up tags.
I've spent the last month writing scrapers for newspaper sites. No one uses any of these things.
- buss 16y agoAre the scrapers hand-tuned to each website? If not how did you do it?
- semanticist 16y agoWe need to extract site-specific metadata, and I'm no expert at NLP, so it's mostly one scraper per site.