3 ms·
> There is no AppleBot-Extended. And if you blocked it in the past it remains blocked. You said there is no Applebot-Extended. The link says otherwise.
by fotta 2y ago
> There is no AppleBot-Extended. And if you blocked it in the past it remains blocked.
You said there is no Applebot-Extended. The link says otherwise.
- ziml77 2y agoIt's still true that there's no Applebot-Extended if it isn't crawling pages. Rather it's a marker to ask Applebot to limit what it does with your pages.
- thomasahle 2y agoIsn't it still true that if people wanted to have their website show up in search in the past (so they didn't block Applebot), then it's too late to mark it as "no training" now, since it's already been scraped? I guess it can be useful for data published in the future.