28 ms·
1 week of Stable Diffusion
- coding123 4y agoIn 30 years everything AI generates will be a red circle, because at that point it will have just trained on itself repeatedly. Instead of labeling data for what things are, we'll have to label things as being generated or not.
- ebabchick 4y agocan someone recommend a good paper or blog post with an overview of the technical architecture of training and running stable diffusion?
- dreamcompiler 4y agohttps://ommer-lab.com/research/latent-diffusion-models/ https://ommer-lab.com/research/latent-diffusion-models/
- metadat 4y agoThey forgot to mention the porn one.. https://www.vice.com/en/article/xgygy4/stable-diffusion-stability-ai-nsfw-ai-generated-porn https://www.vice.com/en/article/xgygy4/stable-diffusion-stab... Why'd they "overlook" it? Probably more culturally significant and controversial than any of the others. It's the natural elephant.
- Workaccount2 4y agoI will not even be slightly surprised when in 10 years we get stats like "60% of all image generation compute power used for making NSFW material"
- metadat 4y agoOr maybe something like "60% of all power on earth". I can't yet decide if it's going to be extremely appealing or quickly get [even more] boring and repetitive.
- ajsnigrutin 4y agoTechnically you could get porn of that one exact weird turnon you have, that there is literally zero porn existing now (except if you pay for a costum video/photoshot). Is this good? maybe... maybe not. Since most of the "normal" stuff already exists, it'll either be something "too extreme" for classic porn studios, or stuff using non porn people to turn into ai-porn stars.
- codetrotter 4y agoAs someone who stopped looking at porn about two months ago, after years of porn use, I can tell you: it’s going to be highly subjective. I used to watch porn basically daily. But then after finally deciding to stop watching porn, the idea of porn itself is downright off putting to me. I don’t even quite know how or why. It just is. And I imagine it will be the same for others with AI generated porn.
- gpm 4y agoMy 3 year old GPU generates one image every ~5 seconds, and according to the documentation draws 215 watts at a maximum steady state load (TDP). That's very roughly a kilowatt second per image. The internet tells me that a 2022 honda civic takes about 0.07 liters of gas per km. And it also tells me that that is equivalent to 2394 kilowatt seconds. I.e. 2394 images on a 3 year old GPU per km travelled using a new and fuel efficient model of car... I'm not worried about this consuming a significant fraction of the power on earth.
- guhidalg 4y agoI agree with your analysis, but I don't think that's how most people interpret global compute power consumption. The stored energy in the gasoline is not counted in global energy production figures, but the electricity used to power your GPU is.
- fifticon 4y agoI appreciate your energy comparison, and it makes sense to me.
- DeRock 4y ago
- prophesi 4y agoI also wouldn't be surprised if 60%+ of the training data is NSFW when it's not filtered out.
- chestervonwinch 4y agoidiocracy is becoming increasingly prophetic
- kgwgk 4y agoI would expect the % of image generation compute power used for making NSFW material to come down over time, just like the % of home video minutes or digital photographs used for making NSFW material went down over time.
- amelius 4y ago> "60% of all image generation compute power used for making NSFW material" Or 80% of all NSFW viewing happens at work.
- ShamelessC 4y ago> Why'd they "overlook" it? It appears to be a site for AI art, so there's that.
- isatty 4y agoThis will be the majority use case for tools like this. I suppose this also extends rule 34 - even if it does not exist, there will be porn of it.
- polisteps 4y agoHi, I'm the creator of multimodal.art, I didn't overlook it, but there's no "specialized" NSFW content maker to be highlighted - this Vice articles just show people using the model in different iterations to generate NSFW content; you don't need a specialized notebook/tool for that, a few ones on the post can do it (others have a NSFW filter that comes in by default). Additionally it is important to note that model was licensed under the OpenRAIL-M LICENSE which is not as permissive as an MIT license and forbids certain outputs to be shared or purposes to be built as apps
- lxe 4y agoI thought only the "derivatives of the model" are under the user restrictions in the license, and are very permissive. The outputs of the model are very briefly covered in the license text > You are accountable for the Output you generate and its subsequent uses. No use of the output can contravene any provision as stated in the License.
- LordDragonfang 4y ago>there's no "specialized" NSFW content maker to be highlighted Unless I'm misunderstanding you, yes there is, and it was even posted on HN last week: https://news.ycombinator.com/item?id=32572770 https://news.ycombinator.com/item?id=32572770 (And yes, many of its results are horrifying)
- GaggiX 4y agoNo, this is just Stable Diffusion without any modification, no fine-tuning is needed to create nudes.
- yarg 4y agoStable diffusion trained on a nude-free data set might struggle somewhat.
- lordswork 4y agoGoes without saying, but enthusiasts are working on it and making progress. Here's a quote from a discussion on it yesterday: as far as I am aware, I may have the only semi-tuned nsfw model, though it's not all that great. There are a lot of concepts that SD needs to learn, and they're difficult to teach. It's very likely that by the time I get something usable, it's going to destroy all of the other concepts. @<another_user> also has a fine tuned model, but it's only tuned on generating closeups of female genitals. If that's all you want to generate, then he's produced some really good results. As for distribution, I wouldn't know where to begin, considering the model is 11GB
- folli 4y agoFunny of Reddit banning the mentioned Subs in a short amount of time. Some years ago, the pendulum was very much on the other side.
- SXX 4y agoReddit want to become public company so it's very much expected result.
- frozencell 4y agoStrange how the same specie who killed its cofounder are the same who lead it now.
- desindol 4y agoOh come it’s the same with twitter he liked the prospect of making lots of money and now he screams foul.
- hackernewds 4y agowho?
- yarg 4y agoHe's not doing that much screaming: https://en.wikipedia.org/wiki/Aaron_Swartz#Death https://en.wikipedia.org/wiki/Aaron_Swartz#Death.
- optimalsolver 4y agoHe was a co-founder in name only. He was forced on the actual founders by Paul Graham.
- yreg 4y agoIs it known what killed those subs? Was it content based on actual people (celebrities)?
- deleted 4y ago[deleted]
- gillesjacobs 4y ago7 days and already that many UIs, plugins and integrations released. To be fair, developer/researcher access was a bit earlier but that is impressive adoption speed.
- RcouF1uZ4gsC 4y ago> 7 days and already that many UIs, plugins and integrations released. That’s because you can use it to make porn. Don’t underestimate the motivational power of being able to easily create porn.
- xor99 4y agoHaha, yes it is the energy that sustained the internet after all
- cbozeman 4y agoThis is the easy answer, but I don't think this is the right answer. The right answer, I'd argue, is that this was Prometheus giving fire to the mortals, and then the mortals quickly discovered everything that could be possible with fire.
- deleted 4y ago[deleted]
- syntaxing 4y agoIt’s really crazy how Stable Diffusion seems to be very on par with DALL-E and you can run it on “most” hardware. Is there an equivalent for GPT-3? I don’t even think I can run the 2M lite GPT-J on my computer…
- xor99 4y agoThis is the killer aspect of it. Running an image in a <5 mins on a Mac is amazing when you consider the alternatives atm.
- acapybara 4y agoFull GPT-6B can run if you have 22gb ram (CPU or GPU depending on where you run it). Also can run an 8 bit quantized version pretty easily. This takes ~6gb RAM. The results seem far off from GPT-3 but apparently it can get good results when fine tuned. Bigger models like OPT 66B can run on cloud machines (or a really big local system) OPT 175B weights are not open but can be applied for. 175B would require something like 500GB RAM if not quantized. That's a lot, but it's possible to build that locally if you have a couple 10's of thousands of dollars. Wait a few years and 175B on a GPU will be no problem.
- boppo1 4y agoWhat does 'quantized' mean in this context?
- acapybara 4y agoBasically stuff a 32 bit value into an 8 bit value (and lose precision). Apparently it doesn't affect the results significantly. More info: https://github.com/huggingface/transformers/pull/17901 https://github.com/huggingface/transformers/pull/17901
- ManuelKiessling 4y agoTangential: I've set up a Discord Bot that turns your text prompt into images using Stable Diffusion. You can invite the bot to your server via https://discord.com/api/oauth2/authorize?client_id=1013373043625705513&permissions=117760&scope=bot%20applications.commands https://discord.com/api/oauth2/authorize?client_id=101337304... Talk to it using the /draw Slash Command. It's very much a quick weekend hack, so no guarantees whatsoever. Not sure how long I can afford the AWS g4dn instance, so get it while it's hot. Oh and get your prompt ideas from https://lexica.art https://lexica.art if you want good results. PS: Anyone knows where to host reliable NVIDIA-equipped VMs at a reasonable price?
- deleted 4y ago[deleted]
- danso 4y agoTangent discussion: What are people's here experiences with running Stable Diffusion locally? I've installed it and haven't had time to play around, but I also have a RTX 3060 8GB GPU -- IIRC, the official SD docs say that 10GB is the minimum, but I've seen posts/articles saying it could be done with 8GB. Mostly I'm interested in the processing time. Like, using a midrange desktop, what's the average time to expect SD to produce an image from a prompt? Minutes/Tens of minutes/Hours?
- Morgawr 4y agoI have a Titan X (Pascal) from like 2015 with 12GB of vram and I've had no trouble running it locally. I'd say it takes me about 30 seconds maybe to generate a single image on a 30ddim (which is like the bare minimum I consider for quick iterations), when I want to get more quality images after I focus on a proper prompt, I set it to like 100 or 200 ddim and that maybe takes 1 minute for one picture (I didn't accurately measure). I usually just let it run for a few minutes in bulk of 10 or 20 pictures while I go do something else then come back half 15-20 minutes later. It runs pretty well but the most I can get is a 768x512 image, but it's pretty good for stuff like visual novel background art[0] and similar things. [0] - https://twitter.com/xMorgawr/status/1564271156462440448 https://twitter.com/xMorgawr/status/1564271156462440448
- chrismorgan 4y agoASUS Zephyrus G15 (GA503QM) with a laptop 3060 (95W, I think) with 6GB of VRAM, basujindal fork, does 512×512 at about 3.98 iterations per second in turbo mode (for which there’s plenty of memory at that size). That’s under 15 seconds per image on even small batches at the default 50 steps, and I think it was only using around 4.5GB of VRAM. (I say “I think” because I’ve uninstalled the nvidia-dkms package again while I’m not using it because having a functional NVIDIA dual-GPU system in Linux is apparently too annoying: Alacritty takes a few seconds to start because it blocks on spinning up the dGPU for a bit for some reason even though it doesn’t use it, wake from sleep takes five or ten seconds instead of under one second, Firefox glyph and icon caches for individual windows occasionally (mostly on wake) get blatted (that’s actually mildly concerning, though so long as the memory corruption is only in GPU memory it’s probably OK), and if the nvidia modules are loaded at boot time Sway requires --unsupported-gpu and my backlight brightness keys break because the device changes in the /sys tree and I end up with an 0644 root:root brightness file instead of the usual 0664 root:video, and I can’t be bothered figuring it out or arranging a setuid wrapper or whatever. Yeah, now I’m remembering why I would have preferred a single-GPU laptop, to say nothing of the added expense of a major component that had gone completely unused until this week. But no one sells what I wanted without a dedicated GPU for some reason.)
- revskill 4y ago7 days trying to install python and their packages and failed. Have to remove those garbages , global dependencies from my machine. Such a waste of ecosystem.
- andybak 4y agoI know several semi-non-technical people that have got this running locally.
- akshayKMR 4y agoTry this one with the docker image instead: https://github.com/AbdBarho/stable-diffusion-webui-docker https://github.com/AbdBarho/stable-diffusion-webui-docker
- drexlspivey 4y agoSomeone on reddit made a single self contained .exe with a GUI (haven't tested it) https://old.reddit.com/r/StableDiffusion/comments/wwh1s9/just_made_a_exe_for_sd_download_it_for_free_on/ https://old.reddit.com/r/StableDiffusion/comments/wwh1s9/jus...
- gigel82 4y agoI'm using the Docker one, so much easier and no worries of polluting my real environment (all the installation scripts tend to download a variety of things from a variety of places).
- fab1an 4y agoI think most are vastly underestimating the impact of Synthetic AI media - this is at least as big as the invention of film/photography (century-level shift) and maybe as big as the invention of writing (millenia-level shift). Once you really think through the consequences of the collapse of idea and execution, you likely to tend think the latter... What we're seeing now are toy-era seeds for what's possible - e.g. I've been making a completely Midjourney-generated "interactive" film called SALT: https://twitter.com/SALT_VERSE/status/1536799731774537733 https://twitter.com/SALT_VERSE/status/1536799731774537733 That would have been completely impossible just a few months ago. Incredibly exciting to think what we'll be able to do just one year from now..
- deviner 4y agoIt doesn't bring anything new, just enhanced on top of what already exists, not even close to photography or film.
- seydor 4y agoAs big as the invention of CGI Still, humans use art to communicate intent, and we still consider AIs to be 'things' , no agency or intent. Being an artist just became a lot harder, because no amount of technical prowess can make you stand out. It s all about the narrative now
- wonnage 4y agoArt has always been about more than technical prowess; it's fundamentally an exploration of new ways to tickle neurons. For more practical purposes like product design, anyone will tell you that actually drawing stuff is akin to typing in code, it can take a while but it's not the hard part
- schroeding 4y ago> we still consider AIs to be 'things' Do we, though? You and I do, sure. Most people here will, probably. But at least one counter-example was on display a few weeks ago, the guy from Google that told the press that their text completion engine was "alive" and "had agency". From my friends I talked about this (which are not in IT), most believed him. YMMV, but I seriously believe a good chunk of the population thinks we already have thinking A(G)I. I don't think there is a "we" here, anymore. :/
- andruby 4y agoIt must be interesting being a graphic artist in 2020-2022. First NFT's that enabled some to make millions of dollars. Less than 2 years later, Stable Diffusion, which will probably shrink the market significantly for human graphical artists.
- throwaway888abc 4y agoThe collaboration,pace and progress is stunning. If this can applied to other fields such climate change etc. Great write up
- lijogdfljk 4y agoThat Figma plugin is mind blowing to me. I'm also curious to see how the Blender integration pans out
- motoboi 4y agoTake a moment to appreciate the fact that in 4,2Gb (less than that actually) you have the English language somehow encoded. This is mind blowing.
- CWuestefeld 4y agoI've been playing with it a bit, and I also find the information theory aspect absolutely amazing. It's more than just the English language that's encoded there. It's also encodes information about characters and the styles of countless artists. I just cannot fathom how all this information fits in that space.
- nickthegreek 4y agoAgreed. My wife plays animal crossing, so I had stable diffusion do some animal crossing prompts and was blown away. This 4gb file understand how all the textures on the objects in this game should look. Then I turned around and was generating liches on thrones in the styles of the painting masters. This is absolutely mind blowing to me.
- m_ke 4y agoAfter playing with it for a few hours I'm sold on it soon replacing all blog spam media and potentially flooding etsy with "artists" trying to pass the renders as their own art work. Here's some of the stuff I generated: https://imgur.com/a/mfjHNgO https://imgur.com/a/mfjHNgO
- timost 4y agoOne use case I have in mind is manga drawing. I wonder if anybody has tested manga related generation.
- ok_dad 4y agoI guess we know where the new market for all those Ethereum miners' GPUs will come from. I have always been sort of bear-ish on the trend towards throwing GPU power at neural nets and their descendants, but clearly there are amazing applications for this tech. I still think it's morally kinda wrong to copy an artist's style using an automated tool like this, but I guess we'll have to deal with that because there's no putting this genie back in the bottle.
- stephc_int13 4y agoAI generated art is interesting and will probably be helpful. I see it as a cheap and fast alternative to paying a concept artist. But not a revolution. Creating precise and coherent assets is going to be a challenge, at least with the current architecture. From a research perspective this is, I think, much more than a toy, those models can help us better understand the nature of our minds, especially related to their processing of text, images and abstraction.
- amelius 4y agoI think what it shows us that activities that we think of as "human", like getting drunk, saying silly things that sound brilliant, or painting things that look stunning are actually the things that a machine has least trouble to copy. Whereas things we associate more with computers, such as hard thinking, mathematics, etc. turn out to be more difficult to copy by a machine, and therefore perhaps more "human".
- cududa 4y agoI've dismissed DALL-E - very cool, but won't really replace everyone. After playing with Stable Diffusion, as an artist, this is the most profound experience I've ever had with a computer. Check this out https://andys.page/posts/how-to-draw/ https://andys.page/posts/how-to-draw/
- Valakas_ 4y agoThis is what a revolution looks like when it is happening. Did you learn about the "Industrial revolution" or the "agricultural revolution" in class? That didn't take a week, or a year, or a decade to happen. Even the Internet revolution took more than a decade. This is a revolution. And you're seeing it happen in real time.
- poisonborz 4y agoJust imagine - you could write your own script of a series and have it realistically generated, especially cartoons, complete with voice acting. Popular generated Spongebob episodes could form canonical entries in the mind of the general public - after some information fallout, original episodes couldn't be even told apart. Postmodern pastiche will accelerate and will become total.