4 ms·
But /x? is for the next page.
by t0 13y ago
But /x? is for the next page.
- pedrocr 13y agoSo apparently you can get two pages of ranking, using / and /news2.
- randomdata 13y agoDepends on the intent. If it is user-initiated (like say a mobile formatted version of the site), it wouldn't have to be obey the robots.txt, since it is not a crawler, just another web browser.