2 ms·

While true, I'm not sure that matters. Unless your intuition is that the data behind such login pages is quantitatively different from what they crawled, the tr

While true, I'm not sure that matters. Unless your intuition is that the data behind such login pages is quantitatively different from what they crawled, the training, model, and findings should still hold, right?

civilized 3y ago
The paper claims there are massive differences between language used on the surface web and the dark web. That is, people talk differently when they're in a different environment that takes special effort to get into. If we have to guess one way or the other, it seems like we should assume the same is true of the crawlable dark web versus the non-crawlable dark web.
MacsHeadroom 3y ago
Not my intuition, but experience. All of Dread is behind a login, for example.