This is really a nitpick. If I can write books in the style of Vonnegut and he loses his entire income (who knows how many millions of dollars), it doesn't matt

This is really a nitpick. If I can write books in the style of Vonnegut and he loses his entire income (who knows how many millions of dollars), it doesn't matter if I first bought some of his books for $100 or just stole them. For AI, they pulled massive amounts of data off the internet. For any copyrighted material, I would consider this fair use, seeing as they used trillions of words of training, any individual work is a tiny fraction. Plus if you ask ChatGPT to give you the text of Cats Cradle, it won't do it, so there is no direct copying happening. Maybe the analogy is walking into a bookstore, reading his books, and then leaving without paying. But it doesn't really matter, because they can retrain without any of that without affecting the model quality all the much, the real magic is transformers + RLHF.