4 ms·
Nail on the head with the walled garden comment. I've been developing all sorts of web scrapers for 10 years now and businesses will go to extreme lengths to s
by wraptile 5y ago
Nail on the head with the walled garden comment.
I've been developing all sorts of web scrapers for 10 years now and businesses will go to extreme lengths to share the bare minimum required. You can really see that if you look at schema.org adoption - the only used fields are the ones that are required by seo. For example, schema's Person object can contain dozens of useful fields but most websites will provide name only even though the rest of the data is available in page content.
Public data is a long lost battle.