3 ms·

I, for one, welcome our new plagiarism overlords. Oops. I added the "haha" in there because the probability of a human doing this kind of goes way down as the

I, for one, welcome our new plagiarism overlords. Oops. I added the "haha" in there because the probability of a human doing this kind of goes way down as the length of the text increases. Can you type, verbatim, an entire chapter of a book? I can't. But, I bet the AI can be convinced in rare cases to do that. The whole thing is very interesting to me. There was an article on here a couple days ago about using gzip as a language model. Of course, gzipping a book doesn't remove the copyright. So how low does the probability of outputting the input verbatim have to be before copyright is lost? Reading the book and benefitting from what you learned? Obviously not copyright infringement. Putting the book into gzip and sending your friend the result? Obviously copyright infringement. Now we're in the grey area and ... nobody knows what the law is, or honestly, even how to reason about what the law wants here. Fun times. (Personally, I lean towards "not copyright infringement", but I'm not a big believer in copyright myself. In the case of AI training, it just makes it impossible for small actors to compete. Google can just buy a license from every book distributor. SmolStartup can't. So if we want to make AI that is only for the rich and powerful, copyright is the perfect tool to enable that. I don't think we want that, though. My take is that the rest of society kind of hates Tech right now ("I don't really like my Facebook friends, so someone should take away Mark Zuckerberg's money."), so it's likely that protectionist laws will soon be created that ruin it for everyone. The net effect of that is that Europe and the US will simply flat-out lose to China, which doesn't care about IP.)

spullara 3y ago
There are people that can type, verbatim, the entire chapters of books.
int_19h 3y ago
China currently has the most stringent limits for LLMs available to end users because of concerns about their political alignment. So if you believe that it's the whole market competition part that's most important in getting the best results long term, they have shot themselves in the foot first. Of course, the models that are developed for internal use by the Chinese government won't be so limited, regardless of what the law says. But then neither be the ones developed by Western three-letter agencies. So don't worry about the "Great Game"; they'll do just fine one-upping each other and screwing over all of us in the process.

spullara 3y ago

There are people that can type, verbatim, the entire chapters of books.

int_19h 3y ago

China currently has the most stringent limits for LLMs available to end users because of concerns about their political alignment. So if you believe that it's the whole market competition part that's most important in getting the best results long term, they have shot themselves in the foot first. Of course, the models that are developed for internal use by the Chinese government won't be so limited, regardless of what the law says. But then neither be the ones developed by Western three-letter agencies. So don't worry about the "Great Game"; they'll do just fine one-upping each other and screwing over all of us in the process.