3 ms·
I'd imagine they already do have a decent portion of Facebook's social graph. The FB graph that Pete Warden harvested with a crawler, and then later deleted aft
by _delirium 16y ago
I'd imagine they already do have a decent portion of Facebook's social graph. The FB graph that Pete Warden harvested with a crawler, and then later deleted after lawsuit threats (http://www.newscientist.com/article/dn18721-data-sifted-from-facebook-wiped-after-legal-threats.html http://www.newscientist.com/article/dn18721-data-sifted-from...), didn't violate robots.txt in its crawling at the time. Given that Googlebot is pretty quick to acquire any web content not robots.txt-protected, I wouldn't be surprised if Google has a copy of something similar.