9 ms·
This is one of the most important moments in all of art history. Millions of people just got unconditional access to the state-of-the-art in AI text-to-image fo
by mkaic 4y ago
This is one of the most important moments in all of art history. Millions of people just got unconditional access to the state-of-the-art in AI text-to-image for absolutely free less the cost of hardware. I have an Nvidia GPU myself and am thrilled beyond belief with the possibilities that this opens up.
Am planning on doing some deep dives into latent-space exploration algorithms and hypernetworks in the coming days! This is so, so, so exciting. Maybe the most exciting single release in AI since the invention of the GAN.
EDIT: I'm particularly interested in training a hypernetwork to translate natural language instructions into latent-space navigation instructions with the end goal of enabling me to give the model natural-language feedback on its generations. I've got some rough ideas but haven't totally mapped out my approach yet, if anyone can link me to similar projects I'd be very grateful.
- bilsbie 4y ago> particularly interested in training a hypernetwork to translate natural language instructions into latent-space navigation instructions with the end goal of enabling me to give the model natural-language feedback on its generations. What are you doing exactly?
- DougBTX 4y agoImagine every conceivable image is laid out on the ground, images which are similar to each other are closer together. You’re looking at an image of a face. Some nearby images might be happier, sadder, with different hair or eye colours, every possibility in every combination all around it. There are a lot of images, so it is hard to know where to look if you want something specific, even if it is nearby. They’re going to write software to point you in the right direction, by describing what you want in text. Here’s an example of this sort of manipulation: https://arxiv.org/abs/2102.01187 https://arxiv.org/abs/2102.01187
- haneefmubarak 4y agoAFAICT: making a navigation/direction model that can translate phrase-based directions into actual map-based directions, with the caveat that the model would be updated primarily by giving it feedback the same way that you would give a person feedback. Sounds only a couple of steps removed from basically needing AGI?
- space_fountain 4y agoI suspect you’d want to start by trying to translate differences between images into descriptive differences. Maybe you could generate examples by symbolic manipulation to generate pairs of images or maybe nlp can let us find differences between pairs of captions? Large nlp models already feel pretty magical to me and encompass things that we would have said required AGI until recently so it seems possible, though really tough
- tailspin2019 4y ago> state-of-the-art in AI image-to-text I think you meant text-to-image!
- mkaic 4y agooh heck, you're right! I edited the original comment, thanks.
- deleted 4y ago[deleted]
- daenz 4y ago>This is one of the most important moments in all of art history. I agree, but not for the reasons you imply. It will force real artists to differentiate themselves from AI, since the line is now sufficiently blurred. It's probably the death of an era of digital art as we know it.
- quadcore 4y agoWait here, this shit hasnt hit France yet :) Those models are trained on artists work and put those same artists out of work. When people will register I dont think this is gonna fly.
- ben_w 4y ago> Wait here, this shit hasnt hit France yet. What is special about France in this case?
- vintermann 4y agoLabour protections/willingness to strike, I suspect they mean. But I don't buy it. I've seen far too many people who "should" be worried about this technology instead be absolutely in love with it. Case in point, the comic artist Jens K (who, f.d, I support on Patreon): https://twitter.com/jenskstyve/status/1560360657148682242 https://twitter.com/jenskstyve/status/1560360657148682242
- gjsman-1000 4y agoMaybe this will signal a return to "real" non-digital artwork and methods...
- deleted 4y ago[deleted]
- wwwtyro 4y agoYeah, the fact that these models are necessarily based on existing works leaves me hopeful that humans will remain the leaders in this space for the time being.
- egypturnash 4y agoIt’s the opposite of exciting if art is your job, lemme tell you.
- boredemployee 4y agoYep. I'm glad that didn't hit other spaces, like music, _yet_
- zone411 4y agoCheck out the melodies I made with an AI assistant I created (human-in-the-loop still but much quicker than if I tried to come up with them from the scratch): https://www.youtube.com/playlist?list=PLoCzMRqh5SkFwkumE578YO4qa1NTkmMi4 https://www.youtube.com/playlist?list=PLoCzMRqh5SkFwkumE578Y.... There are also good AI tools for other parts of making music, like singing voice generation.
- astrange 4y agoSampling has been part of music for a few decades now. That presents all the copyright issues you could want.
- fezfight 4y agoKinda like the creation of copilot and it's ilk for programmers, and gpt3 for writers. Ive seen some talk recently around 'prompt engineers'... Probably to some extent, every job will become prompt engineering in some way. Eventually I suppose the AIs will also do the prompts. At which point I hope we've all agreed to a star trek utopia, or it's gonna get real bad. Or maybe it'll get way better.
- ALittleLight 4y agoI think right now we could setup the AI's to do the prompts. You type in a vague description - "gorilla in a suit" and that is passed to GPT-3's API with instructions to provide a detailed and vivid description of the input in X style where X is one of several different styles. GPT-3 generates multiple prompts, the prompts passed to Stable Diffusion, the user gets back a grid of different images and styles. Selecting an image on the results grid prompts for variation, possibly of the prompt and the images.