4 ms·
The terms of use: https://ai.google.dev/gemma/terms https://ai.google.dev/gemma/terms and https://ai.google.dev/gemma/prohibited_use_policy https://ai.google.de
by simonw 3y ago
The terms of use: https://ai.google.dev/gemma/terms https://ai.google.dev/gemma/terms and https://ai.google.dev/gemma/prohibited_use_policy https://ai.google.dev/gemma/prohibited_use_policy
Something that caught my eye in the terms:
> Google may update Gemma from time to time, and you must make reasonable efforts to use the latest version of Gemma.
One of the biggest benefits of running your own model is that it can protect you from model updates that break your carefully tested prompts, so I’m not thrilled by that particular clause.
- tgtweak 3y agoI don't think there's a way they can enforce that reasonably. There's no connection to the mothership to report back what version is being used or license keys at runtime... Seems more like a "if we discover something unsafe you should update your model and we aren't liable if you don't" than something that would make your model stop working.
- legohead 3y agoSounds like it's "reasonable" for you not to update then.
- wahnfrieden 3y agoIt says you must make efforts (to a reasonable extent), not that you must give a reason for not making efforts
- reissbaker 3y agoThis is a TOS, meaning their enforcement option is a lawsuit. In court, if you convincingly argue why it would take an unreasonable amount of effort to update, you win. They can't compel you to unreasonable effort as per their own TOS.
- generalizations 3y agoThis assumes they even know that the model hasn't been updated. Who is this actually intended for? I'd bet it's for companies hosting the model. In those cases, the definition of reasonable effort is a little closer to "it'll break our stuff if we touch it" rather than "oh silly me, I forgot how to spell r-s-y-n-c".
- reissbaker 3y agoHosting companies can probably just claim they're covered under Section 230, and Google has to go bother the individual users, not them.
- staticman2 3y agoI don't believe that would apply if the host is curating the models they host.
- alwayslikethis 3y agoOh I tried to update, it's just that my router drops the connection after a few hundred MBs...
- wongarsu 3y agoIf you evaluate what it takes to update, and judge the effort unreasonable, that should be enough. Maybe make a powerpoint presenting that result, if you want something for the lawyers. If you don't see a way forward that leads to a result with reasonable effort you don't have to continue working on it until you hit some arbitrary threshold for unreasonable effort.
- a2128 3y agoThis is actually not that unusual. Stable Diffusion's license, CreativeML Open RAIL-M, has the exact same clause: "You shall undertake reasonable efforts to use the latest version of the Model." Obviously updating the model is not very practical when you're using finetuned versions, and people still use old versions of Stable Diffusion. But it does make me fear the possibility that if they ever want to "revoke" everybody's license to use the model, all they have to do is just post a model update that's functionally useless for anything and go after anyone still using the old versions that actually do anything.
- iandanforth 3y agoThese are all very new licenses that deviate from OSI principles, I think it's fair to call them "unusual".
- simcop2387 3y agoI think they meant not unusual in this space, not unusual in the sense of open source licensing.
- alwayslikethis 3y agoFor this sentence to parse, you need to either add or remove a "not".
- ummonk 3y agoSwitching to a model that is functionally useless doesn't seem to fall under "reasonable efforts" to me, but IANAL.
- simonw 3y agoThat's useful context, thanks - I hadn't realized this clause was already out there for other models.
- slowmovintarget 3y agoSo if they wish to apply censorship they forgot, or suddenly discovered a reason for, they want you to be obligated to take it. Good faith possibilities: Copyright liability requires retraining, or altering the underlying training set. Gray area: "Safety" concerns where the model recommends criminal behavior (see uncensored GPT 4 evaluations). Bad faith: Censorship or extra weighting added based on political agenda or for-pay skewing of results.
- pram 3y agoThey have to make sure you’re receiving the most cutting edge chiding lectures when you make naughty and problematic requests.
- astrange 3y agoYou can't make a local model do that. eg force the answer to begin with "Yes" or use control vectors so it agrees with it.
- phillipcarter 3y agoHuh. I wonder why is that a part of the terms. I feel like that's more of a support concern.
- deleted 3y ago[deleted]
- 4bpp 3y agoUgh, I would fully expect this kind of clause to start popping up in other software ToSes soon if it hasn't already. Contractually mandatory automatic updates.
- maronato 3y agoThis sounds like a clause to cover themselves in case older versions have any serious issues
- summerlight 3y agoThis kind of defensive statements in ToS are usually due to obscure regulation or leading cases and model developers need a way to limit liability. There's no practical way to enforce this, but they can claim that when bad things happen it's purely on model users rather than model developers.
- catchnear4321 3y agoreasonable effort - meaning if their changes meaningfully impact my usage, negatively, it would be unreasonable to ask me to upgrade. sounds good. this is not financial advice and ianal.
- res0nat0r 3y agoIsn't this just lawyer speak for "we update our model a lot, and we've never signed off on saying we're going to support every previous release we've ever published, and may turn them off at any time, don't complain about it when we do."
- CodesInChaos 3y agoWe're talking about downloadable weights here, so they can't turn them off, or force you (through technical means) to use a newer version.
- reissbaker 3y agoIt's a local model, they can't turn it off. It's files on your computer without network access.
- catchnear4321 3y agobut what if they send a lawyer to ask firmly? (kindly, but firmly.)
- reissbaker 3y agoThey'd need to send a lot of lawyers, considering that they have no idea how many people are using the model, and very little way of finding out. And they'd need a TOS violation. It would be generally expensive for them to do at scale; this isn't about "turning it off" arbitrarily, it's a CYA in case someone specific does something really bad that makes Google look bad: Google can patch the model to make it not comply with the bad request, and then demand the person running the model update or else lose their license to use the product. It's a scalpel, not an off switch.
- redder23 3y ago[flagged]
- pests 3y agoThey just want no liability for old models.
- yencabulator 3y agoYou think they have any liability for the latest model? https://ai.google.dev/gemma/terms#4.4-limitation https://ai.google.dev/gemma/terms#4.4-limitation
- xyzzyz 3y agoThis is strangely reminiscent of the Soviet Union, where after they got rid of Lavrentiy Beria, they mailed the update to subscribers of the Great Soviet Encyclopedia, where they asked to remove the three pages with Beria’s biography and replace them with the three provided pages.
- samstave 3y agomodel watermarking? does this exist?
- bsimpson 3y agoI appreciated this post clarifying the distinction between "open model" and "open source": https://opensource.googleblog.com/2024/02/building-open-models-responsibly-gemini-era.html?m=1 https://opensource.googleblog.com/2024/02/building-open-mode... I'm not sure how to feel about the restrictions. "No porn" feels prudish, particularly for this millennium. I tend to err on the side of freedom in intellectual/political matters; however, the others seem fairly reasonable as far as restrictions go.
- deleted 3y ago[deleted]
- silverliver 3y agoYou don't have to agree to this policy to use the model.