3 ms·

how does the crawling works, if the URLs content is behind logins or similar?

• nikvdp 5y ago
  Hey wuyishan, right now it isn’t able to retrieve the full text of content that’s behind login walls, but we are looking at ways to allow it to handle those sites as well