4 ms·
Can confirm META's bots aggressively scraping some of my internet-facing services have but they do respect robots.txt.
by s_ting765 1y ago
Can confirm META's bots aggressively scraping some of my internet-facing services have but they do respect robots.txt.