3 ms·

"Distillation attacks", and it's just the exact same thing they did to the rest of the web and all human works.

• brookst 2mo ago
  Explain “exact same thing”? Like it load the Wikipedia page for Fort Worth, Texas, does it make Wikipedia spin up an editor to go write the article? I’m really not sure how you’re getting “exact” here.
  • Gigachad 2mo ago
    Anthropic scraped the whole web, scanned every book, pirated every bit of media to feed in to their training. Distillers are doing essentially the same thing scraping all the knowledge from the LLM to create a training set for a new one. They are crying about theft after committing the largest theft in human history.
    • cdelsolar 2mo ago
      Why is it theft to read all content ever
      • Gigachad 2mo ago
        If it's not theft to do that, then it isn't theft to distill the models. Anthropic wants it both ways.