6 ms·
1. Google denies doing it, so at the very least the title should have an "allegedly". 2. Even if they did – so what? The output from ChatGPT is not copyrightab
by paxys 4y ago
1. Google denies doing it, so at the very least the title should have an "allegedly".
2. Even if they did – so what? The output from ChatGPT is not copyrightable by OpenAI. In fact it is OpenAI that is training its models on copyrighted data, pictures, code from all over the internet.
- mdgrech23 4y agoThis is an argument in bad faith but at this point I have zero trust in corporations and feel like you can generally count on them to do shitty things if they can benefit from it so I can be easily swayed by little proof at this point.
- recursive 4y agoWhat's the argument? What's been done by anyone that's shitty? I don't even understand the point of this post. As far as I know, the current wave of text-based AIs is trained on all text accessible on the internet. Would it be a scandal to learn that ChatGPT is trained on wikipedia? Reddit? What is even the argument here, good faith or otherwise?
- mdgrech23 4y agoThe argument is these companies are using our ideas created by us humans in this thing called the interenet for free and without attribution and it's problematic.
- visarga 4y agoYou can't own ideas, they got their own life-cycle.
- whimsicalism 4y agoRight, but I do think you can "own" (by which I mean our societally-mediated legal definition of ownership in the anglosphere) specific sequences of text or at least the right to copy them?
- abstrakraft 4y agoI'm not necessarily arguing against you, but "problematic" is too generic a term to be useful. Genocide is "problematic". Having to run to the bathroom every 5 minutes to blow my runny nose is "problematic". What do you actually mean?
- dimitrios1 4y agoResponding to sibling comment: We need some clarification here: are we speaking about just ideas in the abstract sense, or ideas that have been fleshed out i.e "materialized" If the latter, there are many laws that say you can own an idea, provided it exists somewhere.
- visarga 4y agoFrom an open source point of view it would be better if scraping proprietary LLMs would be allowed. Small LMs need this infusion of data to develop. But the big news is that it works, just a bit of data can have a large impact on the open source LLMs. OpenAI can't have a moat in their proprietary RLHF dataset. Public models leak, they can be distilled.
- canadianfella 4y agoWhat shitty things are you talking about?
- manojlds 4y agoBut remember many years back when it was news that Bing used Google search results to improve its results.
- cma 4y ago> Google catches Bing copying [search results], Microsoft says “so what?” https://arstechnica.com/information-technology/2011/02/google-catches-bing-copying-microsoft-says-so-what/ https://arstechnica.com/information-technology/2011/02/googl...
- magicalist 4y agoIt's not quite the same thing, because Bing was getting the data from a browser toolbar and watching the search terms used and where the user went afterwards. A closer equivalent would be if someone had made a ShareSERP site and people posted their favorite search terms and the results Google gave and Bing crawled that and incorporated the search terms to links connections into their search graph. The actual actions had maybe gone too far (personally I thought it was more funny than "copying"), the hypothetical would be pretty much what you'd expect to happen. Even google would probably crawl ShareSERP and inadvertently reinforce their own results (the same way OpenAI presumably gets more than a bit of their own results back at them in any new crawls of reddit, hn, etc even if they avoid sites like ShareGPT deliberately).
- KRAKRISMOTT 4y agoOpenAI Terms of service forbid training competitor models via their ML outputs (LoRa alpaca laundering is probably not allowed for commercial use).
- space_fountain 4y agoWhere exactly does it do that? I looked a bit and could t find it, but likely I was just wrong
- short_sells_poo 4y agoI love it how they don't want others to use their model output but they have no qualms about training their model on the copyrighted works of others? Isn't this a stunning level of hypocrisy?
- saurik 4y agoSo, to verify, are you claiming that if someone added a similar clause to their source code and then GitHub went ahead and trained Copilot against it, that would be an issue?
- bloppe 4y agoYou relinquish all licensing rights when you upload your code to GitHub. Microsoft can do whatever they want with it. That's in their ToS, which you have to agree to when you make an account. Normally, only affirmatively accepted ToS are enforceable, so just putting a clause into your license doesn't work (unless it's a copyright, which doesn't require consent).
- flir 4y ago> You relinquish all licensing rights when you upload your code to GitHub What now? Seriously? I found this. Section D4. "We need the legal right to do things like host Your Content, publish it, and share it. You grant us and our legal successors the right to store, archive, parse, and display Your Content, and make incidental copies, as necessary to provide the Service, including improving the Service over time. This license includes the right to do things like copy it to our database and make backups; show it to you and other users; parse it into a search index or otherwise analyze it on our servers; share it with other users; and perform it, in case Your Content is something like music or video." "as necessary to provide the Service" seems critical.
- dragonwriter 4y ago> The output from ChatGPT is not copyrightable by OpenAI. I think the argument here is over the OpenAI Terms of Service, not copyright.
- paxys 4y agoAnd what about the terms of service of my blog or code repository? Does OpenAI respect that?
- dragonwriter 4y ago> And what about the terms of service of my blog or code repository? Does OpenAI respect that? Seems to me that’s an issue between you and OpenAI. (Does your blog or code repository actually have published restrictive terms of service? Did it when OpenAI accessed it? Did OpenAI even access it?)
- deckard1 4y agoYou think OpenAI is going to care unless you have a team of expensive lawyers to back you up? Microsoft is out there laundering GPL code with Copilot. These companies live firmly in the don't give a fuck region of capitalism. Copyright law for thee, not for me.
- bloppe 4y agoSee HiQ vs LinkedIn. ToS has to be affirmatively accepted. I doubt that happened in this case.
- magicalist 4y agoSince it was through ShareGPT, is the argument like "what color are your bits" but for ToS? Maybe if they had put in their terms of service "you can only share this on sites with their own ToS that allow sharing but disallow using the content for training models, and also replicate this requirement", I don't see how you could have any sort of viral ToS like that. Seems more like it's just a bad idea to rely heavily on another LLM's output for training.
- Jimmc414 4y ago>Even if they did – so what? Amplification of biases, propagation of errors, echolalia and over-optimization, lack of diverse data, overfitting
- RosanaAnaDana 4y agoI mean maybe. There also might be something to this. OpenAI has been very opaque about training techniques.
- paxys 4y agoThat's just the base concern with every single model regardless of where they sourced their data from. Garbage in, garbage out.
- educaysean 4y agoSure. Does that fact mean we're prohibited from expressing concerns about data quality? ShareGPT isn't representative of authentic, quality writing.
- Jimmc414 4y agoRight, but training an LLM on the output of another LLM can certainly exacerbate these issues
- paxys 4y agoMaybe, but we are fast approaching the point (or more likely have crossed it already) where distinguishing between human and AI generated data isn't really possible. If Google indexes a blog, how does it know whether it was written with AI assistance and therefore should not be used for training? Heck, how does OpenAI itself prevent such a feedback loop from its own output (or that of other LLMs)?
- abduhl 4y agoYour argument would have a lot more force if we were past that point rather than fast approaching that point. Concerns about training data errors being compounded are much more important when you're talking about the bleeding edge. And your question about how OpenAI prevents their training data from being corrupted is one we should be asking as well!
- Ifkaluva 4y agoRegarding point 2, I think there's nothing "wrong" with it, mainly it's funny that they don't know how to do it themselves. Provides additional evidence that Google is outgunned in this fight.
- karmasimida 4y agoYup The idea of doing this is embarrassing enough for Google. Google index the whole web, some of the documents are due to be generated by ChatGPT, there is no way around it.
- orblivion 4y agoSeems to me like it makes Google look kind of pathetic. That's worse than any legal issue here. (Caveat: assuming I understand the situation correctly)
- naikrovek 4y agoif ChatGPT trained using Bard data, this site would be LIT UP because of OpenAI's association with Microsoft. but it's google so no big deal right?
- ladon86 4y ago> Google denies doing it Read their statement carefully and it's actually not a denial of the allegation. > But Google is firmly and clearly denying the data was used: “Bard is not trained on any data from ShareGPT or ChatGPT,” spokesperson Chris Pappas tells The Verge * Allegation: Google used ShareGPT to train Bard. * Rebuttal: The current production version of Bard is not trained on ShareGPT data Both things can be true: * Google did use ShareGPT to train Bard * Bard is not currently trained on any data from ShareGPT or ChatGPT. It depends on what the meaning of is is ;)
- ithkuil 4y agoIntent matters I guess. Did they accidentally train on that public piece of info they scraped anyway because they are scraping the whole web? Or did they intentionally scrape chatgpt output to see if that would help?
- b112 4y agoThey could have trained, then modified code, repeat, to better enhance training in the current version. Then after, train on raw data.
- m00x 4y agoTrained would mean the current model wasn't trained at all from ShareGPT data, not that was trained on it previously, and isn't being trained anymore. This association makes no sense.
- dang 4y agoOk, I've added that information to the title—thanks. There's also https://www.theverge.com/2023/3/29/23662621/google-bard-chatgpt-sharegpt-training-denies https://www.theverge.com/2023/3/29/23662621/google-bard-chat.... Unfortunately the original report (https://www.theinformation.com/articles/alphabets-google-and-deepmind-pause-grudges-join-forces-to-chase-openai https://www.theinformation.com/articles/alphabets-google-and...) is hardwalled.
- caligarn 4y agoThe Verge doesn’t have an Information sub?
- deleted 4y ago[deleted]
- b7r6 4y agoWhether or not training one giant LLM with socially enormous stakes on the output of another commercially-controlled LLM is an interesting question. My stronger opinion is that the people who can do this stuff via having a crawled corpus of the Internet need to keep in mind that it's all our "user-generated content" that they've freely appropriated to build their models, and so whatever the technical copyright rules are (or become): you don't ethically own something that's closely imitating stuff we all wrote over the years.