2 ms·
I’m suspicious over the scant detail in this claim. I feel like when this has come up in the past, it’s turned out that the training scrapes obeyed robots.txt,
by alwa 2y ago
I’m suspicious over the scant detail in this claim. I feel like when this has come up in the past, it’s turned out that the training scrapes obeyed robots.txt, but the agents browsing in direct response to user conversations were retrieving page content to summarize, in the spirit of following the link on a search result page. Maybe still something people would prefer not happen, but very much ephemeral access in response to an individual user’s query, not training models.
There’s nothing in the linked article to distinguish between those types of requests or usage, and no evidence to suggest the firms are doing other than what they say they are.