3 ms·

Does crawl-to-refer mean that for every 40k pages ClaudeBot crawls, only 1 outbound link is clicked from it?

• johng 1y ago
  Yes, that's exactly what it means.
• avarun 1y ago
  Claude has an order of magnitude fewer users on its web product while training models that are just as large and advanced as OpenAI, so this makes sense.