4 ms·
I recently wanted to find out which company crawls the deepest. The openAI bot was the most thorough one, it followed 405 links [1]. [1] https://deep.43z.one h
by h43z 1y ago
I recently wanted to find out which company crawls the deepest.
The openAI bot was the most thorough one, it followed 405 links [1].
[1] https://deep.43z.one https://deep.43z.one
- fleebee 1y agoNice stats! I've only had GPTBot reach depth 92 on my honeypot. I guess it's not as interesting.
- eric_khun 1y agoWondering if after this comment, you'll get more visit from those bots.
- tonyhart7 1y agosomebody troll that for level 1175 lul
- maxmcd 1y agoSuch a cool idea. I have https://chess.maxmcd.com/ https://chess.maxmcd.com/ and (before blocking most of them) many bots played thousands of moves deep. I remember bingbot was very active.