3 ms·

Love the callout of them definitely training on his own videos

• danpalmer 2y ago
  ...which they shouldn't have been able to get? I had thought that it was against the YouTube ToS? (my personal understanding, unrelated to my employer)
  • Havoc 2y ago
    AI companies don’t give a shit about ToS. Hell most of the big players actively ignored copyright entirely in bulk. See thousand upon thousands of pirated books in the pile dataset. And right after that news broke they “fixed” the problem by stopping to disclose training data sources. Thats why early models had papers eg Llama 1 listed this and now nobody does. It’s just an unspoken yet open secret now.
    • potamic 2y ago
      How did they get access to pirated books?
      • leobg 2y ago
        Anna’s archive has files specifically for training LLMs. But I’d guess the big players secured their share beforehand, by scraping those sites. I have zero proof, it’s just a guess.
  • paxys 2y ago
    If AI companies respected ToS there would be no AI
  • aprilthird2021 2y ago
    The companies are fairly brazen, at least internally, about just scraping whatever, wherever and not caring about ToS of any website. All they really care about is blocking "bad" data that might make the models racist or sexual, etc.