4 ms·
But to a crawler it's one "page". To humans it's different, but not to robot. Crawler still (mostly) "page" == GET
by edoceo 7y ago
But to a crawler it's one "page". To humans it's different, but not to robot. Crawler still (mostly) "page" == GET
- hombre_fatal 7y agoYet here we are discussing TFA that says otherwise, and crawlers are only going to be become better at it. This is a beautiful part of the new web: indexable applications.
- wolco 7y agoCrawlers were suppose to have this down in 2012 (at least google),now they recommend a sitemap page.