3 ms·
I mean you need to crawl often enough that you can determine which site stole content. If a full crawl of the web takes 3 months and A steals content from B af
by Closi 5y ago
I mean you need to crawl often enough that you can determine which site stole content.
If a full crawl of the web takes 3 months and A steals content from B after 2 weeks, it may not be possible to easily infer that A has stolen from B rather than visa-versa.
If I crawl every week and see that A posted it on the first crawl, and B suddenly also had that content on the second crawl, I can infer that B stole from A.