7 ms·
Why Nature will not allow the use of generative AI in images and video
- etrautmann 3y agoDoes this policy apply to cover art as well as figures and data as part of articles?
- morphicpro 3y ago[flagged]
- chasing 3y agoIs it exhausting having to reframe every single thing through a bizarro culture war lens? Seems like it would be.
- morphicpro 3y agoI think is more exhausting using platforms and syndication to promote ideologies that claim to cause harm (but mostly only to those who are successful, while also mostly being used by those who are successful) so thus it should be limited or controlled, though AI has the most value for those who they wish to control as it makes tasks accessible to those with out. To me its more like the people in power fighting to keep that power, of which I could give no shits about. Only thing I could say at this point to those who are still putting up a fight, deal with it. This is a matter of making things accessible, not a matter of who has the most talent. They would like you to think they are more worthy of making art than you. I'd be more worried about that.
- hooverd 3y agoI don't see why Nature is obligated to publish you, free expression or not.
- morphicpro 3y agoI don't see why Nature is pandering the privileged while also saying that people who get aid can fuck off? When you frame it in a matter of accessibility does that make you feel like an ass for telling people that they must make the grade and their work is not worthy? What kind of inclusive community does that create? Oh can't afford $$$ worth of glass and cameras, get lost. That's all I see here. I'm fine avoiding that community all the same too. Think about how many young people who are poor who have no means to get the gear required to participate, except they have this app that would allow them. But this community has made a clear message to that person they are not welcome. I think thats sad and a real statement unto itself and is a perfect reflections of our current "nature"
- skilled 3y ago> for the foreseeable future The publication already has a reputation and I don’t think people would judge Nature if they used Midjourney for featured images. Videos are an entirely different thing, it will take a few more years for AI to be able to create interesting videos, so in a sense it is meaningless to even mention it.
- Der_Einzige 3y agoGood luck enforcing any of these bans. AI models are multiplicities (model + lots of sampling, decoding parameters, etc). In general, it's extremely difficult to prove that anything is AI generated at all. Even more impossible to prove which model was used with which settings.
- colechristensen 3y agoI don’t know, a whole lot of generative AI imagery contains obvious artifacts. Just go down to the noise floor of size and intensity, AI doesn’t look like thermal noise in a sensor or real lens artifacts and fuzziness. Not to mention obvious things like mangled hands or other complex structures.
- jsheard 3y agoThere are also second-order giveaways that someone is using AI generation, in the case of photos the photographer would probably take numerous shots of the subject before submitting the best one, and if challenged they could produce the rest of them as evidence that they're the real deal. As far as I'm aware, using AI to generate a plausible series of photos with all of the details being consistent between them is much more difficult than generating just a single plausible photo. In the case of artwork, the author of even the most convincing, artifact-free AI generated piece will immediately crumble if asked to show WIPs, non-flattened project files or timelapses. I have seen some charlatans attempt to fake WIPs by using style transfer to turn their finished piece back into a "sketch" but the results aren't very convincing, the models aren't trained on the process of creating art conventionally so they're not good at faking it.
- Der_Einzige 3y agoThis is possible today, it's called "reference only controlnet".
- chasing 3y agoPlagiarism can also be tricky to identify and prove. But the reputational harm of lying if you’re caught can be massive and an effective deterrent if you actually care about your career. I’ll say that even in my personal life if I catch you flat-out lying to me about something I have a very difficult time reestablishing trust. It’s like you’ve revealed that deep down you think it’s an acceptable behavior and now everything that comes out of your mouth has to weighed as possible bullshit.
- throw101010 3y ago> Nature will not be publishing any content in which photography, videos or illustrations have been created wholly or partly using generative AI, at least for the foreseeable future. Allow me a bit of a rhetorical question, what are the chances they already publish photos taken on devices that apply by default some form of AI-based generative/corrective algorithms like the "AI detail enhancement engine" by Samsung (the one they use to enhance photos of the moon)?
- asynchronous 3y agoProbably close to 100% at this point.
- LapsangGuzzler 3y ago> devices that apply by default some form of AI-based generative/corrective algorithms like the "AI detail enhancement engine" Isn't this a contradiction, though? My understanding is that generative AI is created entirely from software, using a network of previously created images as input. A corrective filter modifies an image taken directly from a sensor instead. I personally don't mind aesthetic corrective modifications to photos. I was an astronomy observatory last night and learned that most of the magnificent images we've seen of distant nebulas and galaxies have post-production coloring applied, they mostly look black and white coming off the sensor. Does the coloring fundamentally change our understanding of what it is that we're looking at? I don't think so, and that's where I draw the line.
- Imnimo 3y ago>Artists, filmmakers, illustrators and photographers whom we commission and work with will be asked to confirm that none of the work they submit has been generated or augmented using generative AI "or augmented"
- golemotron 3y agoThere's no hard line in the technology. This means that a ban is pointless because the landscape is going to keep changing. It's interesting to compare this to other situations where, say, law tries to create lines that aren't really there and the incentive to ignore imaginary ones is greater than the incentive to keep them. This seems to be a very common phenomenon with technology.
- swayvil 3y agoThis medium, text, pictures, video. It's seductive. It's tempting to pretend that it is reality, but it isn't. I know that's a naive truth and we all know it. But still, we really do pretend otherwise. I think that might be a bigger deal than we acknowledge. I think maybe our sanity is bent from living this way.
- ilrwbwrkhv 3y agoSimulacra and Simulation
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- activiation 3y ago[flagged]
- bentcorner 3y agoI can tell you didn't read the article. > Apart from in articles that are specifically about AI, Nature will not be publishing any content in which photography, videos or illustrations have been created wholly or partly using generative AI, at least for the foreseeable future. Plus in this very article they have a photo containing AI-generated art, but it's done in a way that is obvious - it's a photo of a user using DALL-E with appropriate credit.
- activiation 3y ago[flagged]
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- abeppu 3y agoI think it's unfortunate that they feel pushed to have a blanket policy. Not all images hold themselves out to be representative of a specific truth. If an article calls for an illustrative diagram of, e.g. a generic manifold representing energy associated with points in a parameter space, in context, readers should understand it as a hypothetical case whose specific attributes are not the focus, and there isn't really an opportunity to be 'misled' by it. If an article needs a microscopy image of tissue that has been treated by some factor being studied, then swapping in a DALL-E image in place of one produced through actual microscopy (and post-processing) _would_ be misleading. But the context of what the image purports to represent is critical.
- rflrob 3y agoOne thing that’s confusing is that Nature has two purposes: first as a scientific journal, and second as a science news magazine. They’re bundled in the same physical issue (though there are also branches of the journal, eg Nature Genetics, Nature Chemistry, etc), but internally handled by different staff. I suspect the policy will mostly be relevant to the news magazine side, though you would also want to ensure that a paper on the journal side doesn’t include an AI generated image in a non-AI context. I just asked DALLE for “A scientific illustration of a membrane bound protein being phosphorylated”, and while the results aren’t all that credible, I could imagine using them as a starting point.
- nbardy 3y agoThis wreaks of performative grandstanding. Dictating the tools that artists use for a commission is punitive and moralizing. Let the artists decide the morality of their own profession.
- CharlesW 3y ago> This wreaks of performative grandstanding. It's a straightforward clarification of their existing editorial policy. https://www.nature.com/nature-portfolio/editorial-policies/image-integrity https://www.nature.com/nature-portfolio/editorial-policies/i...
- morphicpro 3y ago[flagged]
- hgsgm 3y agoNature is not an art magazine.
- rkagerer 3y agoGood for them! I'm glad we're starting to see some pushback against the shady practices vendors of this tech employ regarding their datasets. I hope someone figures out how to maintain and apportion attribution (even if it's as awkward as eg. list the million images that contribute >X% to a given result).
- sebzim4500 3y agoI would expect that if X was 1 then there would almost never be a single image that contributes more than X%. So you'd have to make X=0.0001 or something, and then what? Pay them all a fraction of a cent?
- Neilsawhney 3y agoSo sad, they already broke that rule in the first image they included.
- DrammBA 3y agoThat image was not "created wholly or partly using generative AI". It's merely a photograph that happens to contain an AI generated image displayed on a smartphone screen. Funny how they basically show you how to circumvent the new policy.
- cpeterso 3y agoThe article says “Apart from in articles that are specifically about AI”.
- tgsovlerkhgsel 3y agoThat sounds very much like "created partly using generative AI" to me.
- wilg 3y ago> For now, Nature is allowing the inclusion of text that has been produced with the assistance of generative AI, providing this is done with appropriate caveats Why not just apply this rule to all media? What is the purpose of singling out images and video?
- theodric 3y agoFrom my perspective in 2023: based. But in 50 years time will be regarded as a bizarrely conservative, even Luddite, position (unless GPT-9 ends up kicking off WW4).
- seydor 3y agoThis is unimportant - and they are doing it for attribution reasons. But it is irony of the ironies for Nature which sources all its content AND revisions from the open community to say they care about fair copyright compensation of creators.
- HPMOR 3y agoOf course they care about copy right! It is their whole business model after all!! Scihub is “bad” because “copyright” ergo generative AI is “bad” because copyright.
- seydor 3y agoHold on, so you are sayign that because GenAI is using open content it can't be copyrighted properly? Hmm, i wonder who else is using publicly-funded content and editors ... And by the way things like adobe's genAI are definitely using licenced content but nature doesnt even allow that Aren't they unlegitimizing their own business model by claiming such things?
- firefoxd 3y agoI'm sad to see the comments here arguing about small details and nuance. What if the image is from a phone that use ai to do blah blah blah. The reality is we all know what kind of images to expect from Nature. Generative Ai is not appropriate there and we all know it.
- m3kw9 3y agoNot sad just annoying
- matteoraso 3y agoYeah, this backlash is really weird. The only time where generative AI images are appropriate in an article is when the article is actually about generative AI, and Nature isn't banning that. What's the problem?
- slyall 3y agoIf you look at the cover of the magazine[1] about 50% of them are not actual photos of real life. eg 18 May 2023[2] "The cover shows an artist’s impression of two male mammoths fighting" or 20 April 2023[3] which shows the DART spacecraft, apparently photographed from nearby in space. [1] https://www.nature.com/nature/volumes https://www.nature.com/nature/volumes [2] https://www.nature.com/nature/volumes/617/issues/7961 https://www.nature.com/nature/volumes/617/issues/7961 [3] https://www.nature.com/nature/volumes/616/issues/7957 https://www.nature.com/nature/volumes/616/issues/7957
- edanm 3y agoWait, what? Why do we all know that Generative AI is not appropriate? If I just want some random artwork, like an image of, I don't know, a blackboard, why is using Generative AI inappropriate?
- aurizon 3y agoThis is a rear guard action, in a few months - little more, tech will do an end run. https://www.forbes.com/sites/danielfisher/2012/01/18/sopa-meet-the-player-piano-copyright-threat/?sh=7348dbe214d8 https://www.forbes.com/sites/danielfisher/2012/01/18/sopa-me...
- infoseek12 3y agoA lot of diagram generating tools are starting to incorporate generative AI of some form. In some instances the UI probably won’t make it clear that underlying LLM technology is being used. I wonder if their graphics designers will need to move from industry standard software to something less capable. Interestingly the Amish may have been ahead of their time in creating purposely limited technology that was compatible with their beliefs (https://www.npr.org/sections/money/2013/02/25/172886170/a-computer-fit-for-the-amish https://www.npr.org/sections/money/2013/02/25/172886170/a-co...).
- goerz 3y agoWhich diagram generating tools?
- infoseek12 3y agoAdobe and Figma are two of the leading companies in that space. They seem to be integrating the new tech at a fairly rapid pace: Adobe - https://www.adobe.com/sensei/generative-ai.html https://www.adobe.com/sensei/generative-ai.html Figma - https://www.figma.com/community/plugin/1145446664512862540/Ando---AI-Copilot-for-Designers https://www.figma.com/community/plugin/1145446664512862540/A... Some new tools have popped that are centered around generative AI (I have no idea if they’re any good): Prototypr - https://prototypr.io/toolbox/diachat https://prototypr.io/toolbox/diachat Diagram - https://diagram.com/?ref=Welcome.AI https://diagram.com/?ref=Welcome.AI
- goerz 3y agoCool. Thanks!
- varelse 3y ago[dead]
- inciampati 3y agoI just published conceptual art that I created using Midjourney in Nature! Ironically, Nature's own licensing rigor drove me to generate this art. It was replacing content that had come from other sources, where the time to obtain and clear copyright was too long for our timeline. More hilariously, one of the images that I replaced was from the US government, and in the public domain. The other was from a consortium in which I am part of the project leadership. They seemed perfectly okay with this, as long as I proved to them that I had the professional Midjourney account where copyright is not encumbered. I wonder when they will again allow this kind of use.
- firefoxd 3y agoCan you share the article?
- PlasmonOwl 3y agoHahahahah. Nature. Integrity. Fuck me.
- dclowd9901 3y agoApropos of nothing, I’m always really encouraged to see companies take strong philosophical stances like this. I don’t think it’s a particularly controversial stance, but all the same, it’s encouraging to know they want to promote integrity in this space and try to set an example.
- neilv 3y ago> Saying ‘no’ to this kind of visual content is a question of research integrity, consent, privacy and intellectual-property protection. Evidence that STEM people can think clearly about this, when their paycheck doesn't depend on pretending otherwise. (Personally, I'm going to be in the latest AI techbro gold rush, but will try to do it responsibly.)
- malkia 3y agoBut it just did, in the article itself - https://media.nature.com/lw767/magazine-assets/d41586-023-01546-4/d41586-023-01546-4_25335740.jpg?as=webp https://media.nature.com/lw767/magazine-assets/d41586-023-01...
- mgraczyk 3y agoSecond paragraph of the article: "Apart from in articles that are specifically about AI"
- mgraczyk 3y agoThe first justification in the article is silly and detracts from Nature's position: "we all need to know the sources of data and images, so that these can be verified as accurate and true" How do you verify whether this cartoon illustration of of stacks of money against a red background is "accurate and true"? https://media.nature.com/lw767/magazine-assets/d41586-023-01729-z/d41586-023-01729-z_25408252.jpg https://media.nature.com/lw767/magazine-assets/d41586-023-01... Would it have made a difference if that image were generated by Midjourney? The actual reasons, given later in the article, are that Nature is taking a political/legal position on copyright and privacy. That's fine by me, but it's disappointing that they give a misleading and nonsensical justification before the actual justification, as if to make their stance sound less political.
- firatsarlar 3y agoThis is just one of many perspectives, highlighting an approach based on results. Generative AI is simply a process that produces output aligned with our expectations. It should revolve around managing expectations and embracing different perspectives. Rather than delving into mystery and religion, which might take us outside the realm of academia, perhaps we could explore alternative fields. Let's consider an image of a sleeping cat: I attempted both photographing a real cat asleep and generating an image using MJ. Interestingly, the AI output resembled a "cat pretending to be sleeping," while the other cat was genuinely asleep. It's all about the standards we set.