13 ms·
Run your own DALL-E-like image generator
- illuminati1911 4y ago”Run your own text to image prompts with CUDA, a bunch of disk space, and an insane amount of memory.” The ”insane amount of memory” turned out to be 32 GB or more. I thought we are talking about 512 GB or something like that.
- pwillia7 4y agoincluding the GPU memory I say it's insane :) -- Also, you need more than 32GB of RAM to follow the instructions verbatim in the repository. People were saying the scann indexing fails even with 64GB of RAM.
- Tepix 4y agoMany AM4 boards that cost 70€ or so support 128GB RAM. 128GB = 4x 32GB DDR4 UDIMM costs less than 360€. That's a lot less than the GPU.
- throwaway743 4y agoiirc any CUDA requirement requires an Nvidia GPU
- Tepix 4y agoYou can plug nVidia GPUs in AMD boards...
- throwaway743 4y agoYeah but that's out of the context of multiple am4 boards and their RAM caps being able to replace a GPU or being cheaper than a GPU. Yeah they're technically cheaper than a GPU, but your costs are still gonna be up and they can't replace a GPU because regardless you'll need an nvidia card, unless there's a workaround for CUDA requirements.
- Tepix 4y agoI thought you need both a GPU and a lot of memory for the CPU.
- pwillia7 4y agotru
- OhNoNotAgain_99 4y agoComputing neural nets isnt something a CPU is optimized for (matrix calculations), This tech is based on gpu optmized LSTM's, acka Transformers, they can run on cuda, reducing time. GPU's perform those calculations fast for huge matrixes. Doing it on a CPU (they're no good in fat matrix caclulations) it takes forever. And yes.. essentially those neural nets are extreme huge matrixes with some predictive math in between.
- sailingparrot 4y agoAlternatively, if you don't have a (good enough) GPU, you can also run it on Google Colab using one of the many available notebooks. For example, this one [1] works very well. Google Colab comes with a fair amount of GPU time for free. [1]: https://colab.research.google.com/drive/1TBo4saFn1BCSfgXsmREFrUl3zSQFg6CC https://colab.research.google.com/drive/1TBo4saFn1BCSfgXsmRE...
- frankzander 4y agoTBH ... I absolute hate this AI generated strange images. Most folks are celebrate this technology but I don't know what it's really for other than confusing brains. I always ask myself "is this real" ... I don't like to ask myself if something is real or don't like to be confused. Is anyone else out there who feels the same?
- manimino 4y agoWhen computers started beating humans at chess, there was a similar moment of anxiety. One good quote from that era: "You should be no more concerned that a computer can beat you in chess than that a car can beat you in a race." Technology changes the experience of being human. Chess used to be the marker of human intelligence; that passed. Now some forms of creativity will too.
- frankzander 4y agoI'm not anxious about it. It's just not pleasant to see. There are some painters like Dali (I assume Dall-E is not by accident) or Bosch who had created kinda similar "products" but to me they are interesting and fun to look at. The AI products are kinda useless creap, mashups without sense from dump machines and that's give me this wired feeling which makes me hate it.
- anon2020dot00 4y agoThere is no need to worry about the threat of AI. While it is true that AI has the potential to cause great harm, it is also true that AI has the potential to do a great deal of good. As long as we are careful and responsible in our development and use of AI, there is no reason to believe that it will be anything other than a positive force in the world. -- generated by OpenAI from a prompt
- frankzander 4y agoYes I assumed it from the first few words that's kind of a AI product.
- 4y ago
- can16358p 4y agoThis looks lovely and I absolutely love where this is going. However, it would be very cool if deep learning tools weren't dependent on CUDA and could be run on, say, any GPU with OpenCL.
- blagie 4y agoIt would be lovely if anyone other than NVidia made GPUs useable for GPGPU. I started with Radeon for the open-source factor, but it turned out to be useless in virtually every respect. I bought an NVidia card. I'm now tied to CUDA, but I didn't need to be. I was starting from scratch. The longer before AMD can ship something which actually works, the more entrenched NVidia+CUDA become. At this point, I lost hope.
- atwood22 4y agoWould targeting Vulkan instead of CUDA help?
- naavis 4y agoThey don't really serve the same purpose. Vulkan is a low-level graphics API while CUDA is a much higher level toolkit for GPGPU.
- blueblob 4y agoIt's not that they aren't trying, it's that when you reinvent the wheel, you have to do more work. Microsoft is introducing `tensorflow-directml` to avoid this problem by implementing a CUDA equivalent in directX. AMD has ROCm, but it's not well supported because it's not integrated upstream in `tensorflow`.
- blagie 4y agoWell, I bought a ROCm GPU for GPGPU: - I found out I could only use it for compute headless. WTF?!?!?! (https://www.phoronix.com/news/Radeon-ROCm-Non-GUI https://www.phoronix.com/news/Radeon-ROCm-Non-GUI). If it was driving a monitor, my machine would crash hard. There wasn't even an error message. - A lot of other stuff didn't work and just resulted in odd crashes, or worse performance than CPU. I don't know why. - Within 9 months, AMD discontinued support for my card. I raised this as a warranty issue (suitability for advertised purpose), but that obviously would go nowhere without a lawsuit. I had a very expensive brick. - AMD support channels were non-existent. There literally was no way to reach anyone. I bought an NVidia card, and it's been working well ever since. ROCm is not well-supported because it's absolute garbage. You have *less* work reinventing wheels, since it's been invented once. You have more work to get community support and network effects, since you're starting out behind. Fundamentally, though, that can't start to happen if your system doesn't work at all. I agree with you they're trying, but they're trying incompetently. If ROCm was half the speed of CUDA, and wasn't integrating into the latest-greatest frameworks, but it was stable and working, I'd make it work. It wasn't anywhere close to stable and working.
- upupandup 4y agoAsking for a friend, can this be used for porn she wants to know.
- speedgoose 4y agoYes, but you will see things you don’t want to see.
- NicoleJO 4y agoFriendly reminder: If you're considering incorporating someone else's work into your new work, you need to be aware that you may be violating the copyright to the original work. https://www.legalzoom.com/articles/what-are-derivative-works-under-copyright-law https://www.legalzoom.com/articles/what-are-derivative-works...
- kurishutofu 4y agoAnyone know how this compares to min-dalle?
- andybak 4y agoYou can also use Visions of Chaos on Windows which has semi-automatic installer for several dozen models: https://softology.pro/vocrev.htm https://softology.pro/vocrev.htm (I'm a Patreon supporter but otherwise have no connection)
- Workaccount2 4y agoWith the explosion of image gen AI out there recently, I feel confident that within a year anyone will have access to free or nearly free totally unchained image generation on par with or better than current DALLE-2.
- EZ-Cheeze 4y agoStable Diffusion is free and much better than DALL-E at faces. Not open to everyone yet but getting there.
- kuboble 4y agoIt might be better at faces but I've access to stable diffusion and on my prompts it performed significantly worse than dalle.
- yreg 4y agoRunning it is one thing, but where are we going to get the model? Who is going to give away their trained model (that presumably cost millions) to the public? And getting the blame for any nefarious usage that will eventually follow?
- GaggiX 4y agoStabilityAI with Stable Diffusion
- yreg 4y agoHave they said they are going to publish the trained model? So far they are going the exact route as OpenAI (closed beta access with similar prompt content policy).
- GaggiX 4y agoYes, the repository has already been released, the weights will be released soon. And no, the content policy is nowhere near as strict as OpenAI's.
- matsemann 4y agoWhat I hate about the current ML space is that half the time is spent trying to get dependencies installed and set up correctly to match whatever project you're trying to run expects. Everything is just so brittle. Following tutorials like these never work out of the box.
- 8f2ab37a-ed6c 4y agoWhat is the solution? Is there a reason why things are not better? Can all of the deps be loaded in a Docker image and be done with it?
- Kuinox 4y ago> What is the solution? There are languages ecosystem that solved these issues and never have a problem with it. Look at it, and copy their tooling.
- dismantlethesun 4y agoWhat are some of those ecosystems?
- mattkrause 4y agoJulia's package manager has basically never failed on me.
- dismantlethesun 4y agoThanks. That’s something to look into then.
- adgjlsfhk1 4y agoNote that the Julia package manager (while very good) is very similar to (and largely inspired by) the rust package manager.
- zimpenfish 4y agoI've got the LD repo installed and use it alongside VQGAN-CLIP and ... VQGAN is pretty much always the better result (albeit much slower.) I -think- this is because the (tagging?) that the LD is using isn't as comprehensive. Like it doesn't seem to know what "brogue" means and generates nonsense with attempts at the word "brogue". (Caveat: I have updated neither repo since about November because it took a faff to get them working and I do not want to touch them again.)
- margoguryan 4y agoCLIP is my favorite of all of them. But it's not especially friendly - like riding a horse bareback. I've made some ridiculous, very bizarre and interesting stuff with CLIP that just isn't possible with DALL-E.
- epivosism 4y agoPossibly useful: midjourney offers image creation via discord, 200 images/10$ or a subscription plan for more. It's great fun and possibly is an easier way to test out the tech. AI art notes in general: * this will permanently raise the standard of "programmer art" in prototype UIs, for example. * I expect large-scale AI image creation social games will take off very soon * utilities to listen to your conversations and illustrate people's points with poetic interpretations on screens next to you with captions. * this will/should be integrated with emoji / emoji kitchen-like systems - imagine iterating on a custom emoji-like response in snapchat! * trademark/copyright wars over input data may ruin this
- irq-1 4y agoWow. Great ideas, thanks for sharing. I'd like to see image>text ai so it can explain what it's seeing, for driving, etc...
- yonixw 4y agoCurrently free trial [1] of 25 images if anyone wants to try... But I would also suggest [2] which is the one used in the article already deployed for free [1] https://discord.gg/midjourney https://discord.gg/midjourney [2] https://huggingface.co/spaces/multimodalart/latentdiffusion https://huggingface.co/spaces/multimodalart/latentdiffusion
- ev1 4y agoI'd be happy to pay but my god at least give me a rest api to curl by hand and not discord of all things.
- hnfong 4y ago+1 would recommend Disclaimer: I subscribed and when I came to my senses 5 hours had passed and I had a gallery of weird pictures...
- simonw 4y agoI tried doing this on my own laptop a few weeks ago using Hugging Face diffusers - https://github.com/huggingface/diffusers https://github.com/huggingface/diffusers Here's the code: from diffusers import DiffusionPipeline ldm = DiffusionPipeline.from_pretrained( "CompVis/ldm-text2im-large-256" ) output = ldm( ["a painting of a raccoon reading a book"], num_inference_steps=50, eta=0.3, guidance_scale=6 ) output["sample"][0].save("image.png") This took 5m25s to run on my laptop (no GPU configured) and produced a recognisable image of a Raccoon reading a book. I tweeted the resulting image here: https://twitter.com/simonw/status/1550143524179288064 https://twitter.com/simonw/status/1550143524179288064
- at_a_remove 4y agoI can only dream. While at first I was excited by the mini and the mega versions of DALL-E 2 people were hosting, even if they were blurry and often a little dumb, by the time I got my DALL-E 2 invite, I had ideas ... most of which were swiftly rejected. Not only that, it suggested that I would lose my asking privileges if I kept it up with the weird prompts. Sigh, when will I have a nightmare generator of my own?
- donkeyd 4y ago> it suggested that I would lose my asking privileges if I kept it up with the weird prompts This makes me hella curious about the type of stuff you were requesting.
- at_a_remove 4y agoMy first request was a Captain Beefheart lyric ("making love to a vampire with a monkey on my knee") because I wanted to see how it would take something concrete "monkey on my knee" and integrate it with not only a metaphor, but one that had changed over time ("making love" used to refer making out, a.a.a. prolonged kissing, rather than sex). Additionally, I wanted to see if it had hoovered up a rendition of that exact lyric off of Exploding Dog (an artist makes odd drawings from submitted phrases and prompts) some twenty-two years prior. Of all of the celebrities, it seemed reticent to draw Fred Rogers as, well, Fred Rogers, despite me being able to make some fairly appalling melds of others, like Rod Serling and Marilyn Monroe. Additionally, someone has put in an overly-touchy anti-vore filter.
- margoguryan 4y agoI've tried to do a bunch of prompts involving, like, pirates and cannons - rapiers and daggers. 16th century Treasure Island aesthetic. No bueno. I also tried uploading a film still, and it said I may not use realistic faces. So I used another AI tool to remove the face. It still wouldn't budge.
- Miraste 4y agoI expanded on this in another comment, but their content policy is incredibly restrictive: https://labs.openai.com/policies/content-policy https://labs.openai.com/policies/content-policy There are a number of other rules that can only be discovered by combing their Discord or running into them headfirst.
- liminalsunset 4y agoSeems like a decent amount of training data does end up making it into the output - some of those images have a barely legible "shutterstock" white footer in them or something
- ionwake 4y agoHi, Sorry if this is extremely ignorant. But I was wondering the other day... are we 100% sure they arent feeding images from a search engine index into the ML data for Dalle? It just looks surprisingly like its mixing and matching the top returned image searches from an index. I'm only saying it looks like that - not that it is ofcourse. I don't want to undermine anyones works here, I was just wondering.
- adamsmith143 4y agoThis is not the case. If you want go ahead and try to generate pictures and then find the supposed source image it came from. Good luck.
- knicholes 4y agoYou can read the whitepapers for Flamingo, Dall-E 2, Imagen, and Parti to see how diffusion networks and GANs work to create these images. I wrote up two huge paragraphs trying to explain it simply, but then I realized that I don't understand exactly how they work, either. Best source is the published research. Most networks have to do with large language models, text embeddings, and image embeddings.
- mbushey 4y agoHow many hundred thousand dollars of GPU hours are required? It's not like it's possible to download pre-trained data for these type of things.