3 ms·are you sure about respecting robots.txt?by artembugara 6y agoare you sure about respecting robots.txt?Google234 6y agoYes they do. Does newscatcherapi respect them?