3 ms·
The rest are scrapers which I didn't bother to label. Google, Bing, Semrush, Ahrefs, Pinterest, Yandex, BLEX, Petal, MJ12Bot, Neeva, MetaJob.. They're probably
by dj_mc_merlin 4y ago
The rest are scrapers which I didn't bother to label. Google, Bing, Semrush, Ahrefs, Pinterest, Yandex, BLEX, Petal, MJ12Bot, Neeva, MetaJob..
They're probably overrepresented in this data set since I collected logs from about a dozen sites, but only a couple of them have any real popularity while all get scraped due to SEO.
- jhardy54 4y agoMakes sense, thanks for indulging my curiosity.