2 ms·ask first, or respect robots.txt no semantic malarchyby rolph 4y agoask first, or respect robots.txt no semantic malarchy