4 ms·It's because pg disables bot crawling to keep server load down.by cdvonstinkpot 13y agoIt's because pg disables bot crawling to keep server load down.