No, whether I curl it, or I use a browser, or an LLM, it is essentially ALL the same, unless of course the LLM crawls it by itself, without human interaction.

No, whether I curl it, or I use a browser, or an LLM, it is essentially ALL the same, unless of course the LLM crawls it by itself, without human interaction. If the scale bothers you, block it, just like how you would block any other crawlers. Other than that, we all wanted "ease-of-access" (not me though), and now we have it. It does not change anything.