5 ms·isn't this what robots.txt for? can't you block facebook?by shultays 6y agoisn't this what robots.txt for? can't you block facebook?detaro 6y agoAs the article clearly states: noshultays 6y agowhoops, my laziness. sorryDreadY2K 6y agoThe article mentions that they tried that and the crawler ignored it.