13 ms·
A few things to try with DALL·E
- spaceprison 5y agoI want to see this combined with something like ai dungeon.
- BlueTemplar 5y agoI suppose that the mere thought of something like "loli dungeon" goes a long way to explain why OpenAI is very careful about who and what they allow... (Yet, considering what happened with deep fakes, it's only a matter of time now... :/ )
- whywhywhywhy 5y agoHow do we actually try it? Oh like all OpenAI tech we can’t…
- criddell 5y agohttps://labs.openai.com/waitlist https://labs.openai.com/waitlist You probably can't try it today, but if you are patient you will be able to.
- almostdigital 5y agoIt's interesting to see that Latent Diffusion + LAION 400M does much better with text, it's actually a challenge sometimes to get it to not write the parts of the prompt meant to guide the style on the resulting image. Try it yourself here: https://colab.research.google.com/github/multimodalart/latent-diffusion-notebook/blob/main/Latent_Diffusion_LAION_400M_model_text_to_image.ipynb https://colab.research.google.com/github/multimodalart/laten... EDIT: Here's 36 uncurated renders for "Hacker News - Dang's Dance. R&B Album Artwork" https://johan-nordberg.com/tmp/hn-laion400m.png https://johan-nordberg.com/tmp/hn-laion400m.png
- kahon65 5y agoFirst link colab doesn't work, output_path variable not declared when running the last block even if first one, censed to declare it, is run.
- almostdigital 5y agoTry Runtime -> Run All Or use the huggingface version, that's a simple web ui: https://huggingface.co/spaces/multimodalart/latentdiffusion https://huggingface.co/spaces/multimodalart/latentdiffusion
- EZ-Cheeze 5y agoby default nsfw_threshold=0.5 nsfw_threshold=1 for no filtering
- bowmessage 5y agoNice. Now, let's have it generate some FLAC files.
- KaoruAoiShiho 5y ago"Creative application". That's just going to get automated too. We're in the twilight of art, if not humanity.
- gfodor 5y agoMore likely we are at the dawn of something we can’t yet understand.
- speed_spread 5y agoWe are at the dawn of something that might understand us.
- akie 5y agoWe don't even understand ourselves.
- PoignardAzur 5y agoYeah, but the thing will be a lot smarter than us.
- snek_case 5y agoWhat's a bit worrying here is that life has had billions of years of evolution to shape its instincts (i.e: empathy, self-preservation, desire to explore, etc.). Our basic instinctual drives are tuned in a way that the system is more or less stable, the species doesn't go extinct. We're in the process of creating machines whose drives will be completely artificial, not shaped by natural selection. We're going to shape them... Or, more accurately, greedy corporations, billionaires and leftists are going to imprint an approximation of their own morals and goals in there, for better or worse. Those machines will also inevitably end up a lot smarter and more capable than we are. It's possible that if we fuck up the programming, we just just won't be able to stop them from transforming the world into whatever they want... If the world they want is toxic or unsustainable, good luck trying to reprogram a machine that's faster, stronger and smarter than you. It's going to be the other way around, the machines will reprogram us if it suits their needs.
- NickM 5y agoDoes anyone know why the text content in the images is weirdly off from the prompts? I couldn’t tell if that’s just a known limitation of the model, or a result of the author giving the prompts in some other language or something.
- klipt 5y agoDall-e knows how to draw things that look somewhat like writing, but doesn't actually know how to write.
- astrange 5y agoIt's because the model doesn't actually see text during training or prompting, it gets a compressed form called BPE instead, and the compression is fixed rather than learned.
- BlueTemplar 5y agoI wonder how it compares to human dyslexia ?
- thomasfromcdnjs 5y agoAnyone know how to get a faster invite? I've been paying for GPT-3 for over a year.
- teaearlgraycold 5y agoThey’re going to be very cautious. I work for a company that pays OpenAI a silly about of money every day and only a handful of employees have DALL-E access.
- visarga 5y agoThat really drives the "Open" part of OpenAI. Open to silly amounts of money AI.
- unnouinceput 5y agoI'm OK with that. Free opening this thing and guess what will happen. Rule 34, child pornography and murder scenes will explode all over internet. Want your own free movie with your favorite non-porn actress doing scat scenes? Guess what, it will be over in next millisecond once you explain it to DALL-E. No thank you, some thing are better kept under tight security and shitload of money. But here is the kicker, as the technology progresses this will become just normal part of your device you carry. I pity our grand-kids and the world they'll live in.
- bavell 5y agoIIRC they already have a NSFW filter in place which removes unsavory prompts and output images.
- teaearlgraycold 5y agoThey didn’t even show the AI porn. It has no idea what it looks like
- wferrell 5y ago
- Nition 5y agoWhat is the content of the training set like, that DALL·E 2 has all this info? Are there people out there spending thousands of hours just tagging or writing descriptions of training images? And does DALL·E just receive the image as-is with its description, or does it get more info (e.g. "this part of the image is the dog")?
- astrange 5y ago> What is the content of the training set like, that DALL·E 2 has all this info? Web crawling. (https://arxiv.org/pdf/2103.00020.pdf https://arxiv.org/pdf/2103.00020.pdf 2.2) > Are there people out there spending thousands of hours just tagging or writing descriptions of training images? "Yes", Google Image Search, Wikipedia captions, Danbooru are all that in some sense. The biases should be obvious if you think about it for a minute and CLIP has even more biases since they removed all kinds of NSFW content, etc. > And does DALL·E just receive the image as-is with its description, or does it get more info (e.g. "this part of the image is the dog")? Only that, but segmentation is a big research area too and it looks like FB has a reproduction with some of that mixed in. https://arxiv.org/abs/2203.13131 https://arxiv.org/abs/2203.13131
- Nition 5y agoThank you for the info!
- fxtentacle 5y ago+ Flickr, a huge AI-friendly database of human-captioned images And the DALLE architecture can also handle masking where you initialize only part of the latent space with noise and initialize other parts with a starting image. The video on their website shows examples of that to replace a pet on a chair.
- astrange 5y ago> + Flickr, a huge AI-friendly database of human-captioned images You're right, I forgot to mention them. Their metadata is great, and most importantly photos have their licenses tagged and many of them are CC0 (including mine). Are content and content tags that great though? I don't content tag my own photos there, and when I've tried to comparison shop cameras all the popular images are over edited /r/shittyhdr art… Metadata seems really interesting though. You'd think a visual search AI would want to know the white balance EXIF tags on a photo, so it knows if a yellow object is actually yellow or just under a streetlight.
- mjh2539 5y agoHow do we get the hook-up? I'm still on the waitlist.
- visarga 5y agoThe only allow ~400 people in so far, in order to test the model. They say they will open it to the public later this year. Foundation models are being scrutinised by a large number of critics. The new papers devote half the space to safety, countering biases and energy use or they could face harsh reception.
- dougmwne 5y agoGTP-3 really rocked the HN world a few years ago, but the general public never heard of it. Prediction: people love images and this could be the moment AI generation goes mainstream.
- testmasterflex 5y agoWe discussed that yesterday among my friends but nobody could come up with a good use case. Let’s say Art. What makes art valuable in a sense is that artists have an opportunity cost of doing that art. It’s a sacrifice of something else in their life. AI art gets inflated instantly. Everyone can get a beautiful painting in a button click. Not valuable. Can someone come up with a use case for this?
- jimkleiber 5y agoOh I can probably come up with many use cases. Business models? I'm not sure. I could use it for...inspiration, stock images for a demo site, actual images for a live site, t-shirt designs, coffee mugs, and those drop shipping products, podcast or album artwork, etc. Yes, maybe design starts to blend, yet lots of web designers used Bootstrap and Material Design so that sites started to look the same anyway. Maybe it'll just be things looking the same except with more artistic images.
- deadcoder0904 5y agoplenty of business models. anything that requires designers can be used with dall•e for a monthly cost. designers require $1k-10k a month (assuming you're in us) & dall•e can greatly reduce that cost to $100 a month through scale. i believe dall•e is even more useful than gpt-3 because as of now, only real business model that worked for gpt-3 was copywriting. dall•e will have branches under images like tshirts, replacing desingers or providing designers with more inspiration, stock photos, nfts & so much more...
- testmasterflex 5y agoSorry what I meant with “use case” is of course business model and you catched that. I’m not convinced that people would pay for that at all. It could be a helpful tool for a designer but if you’re saying someone would pay to get something done in the press of a button click I think that’s a very short term business that will be outmatched by an open source free alternative almost immediately. Just look at how fast web designers are getting outcompeted by free frontend frameworks like Bootstrap or icon libs like Font Awesome. Perhaps I’m just explaining the natural way of business and commodities, and most goods and services follows this pattern.
- burlesona 5y agoIt’s fascinating how many people feel that this is a specifically powerful breakthrough toward AGI, I suppose because it seems creative. Don’t get me wrong, this is extremely cool! But art and composition are “pattern languages” that seem well-suited to our current ML techniques given sufficient investment in training. To me this feels more like progress toward the Star Trek computer, which we can interact with in basically natural language, and which can do sophisticated knowledge operations for us (from natural language instructions), but which still doesn’t “think” in a meaningful way. Now, when Dall-E 5 starts to argue with you about which art style looks best or will be most marketable…
- Lambdanaut 5y agoGPT-3 has been able to argue with you about which art styles look best or will be most marketable for over a year now
- robbedpeter 5y agoI don't think a lot of these critics realize how capable gpt-3 is of convincingly outsmarting most people in most contexts. The failures are glaring, and you'll no doubt catch them over time, but transformers are a sea change in ai power. If gpt-3 can meet or beat human performance 80% of the time, that's sufficient for me to call it real intelligence. Not conscious or aware in any meaningful way, but smart, in many of the ways humans are smart. In most online contexts where conversations are singular collisions between individuals who often don't have history, 80% of the real-seeming interactions you have could be gpt-3 output. In a many-shot, recursive, and domain targeted sequence of prompts, the percentage only improves. The recursive, self referential functions learned by these models are not mere extrapolation from Markov chains and static stimulus/response bots. These models are approximating the functions required to produce human level output. They are approximating the functions biological brains use to produce output. Even the naive, single pass probes into gpt capabilities we've seen in the last two years are incredible compared to aiml or even the best bots until ~2018. It's not agi, but it's evidence that agi is feasible, and a definitive milestone on that path. We need to be preparing for takeoff.
- EZ-Cheeze 5y agoNext crazy thing: accurate time evolution of photographed phenomena "DALL-E + 0.001ms" ran continuously = reality sim Based on previous frames, it'd be able to predict that two water drops would coalesce within the next dozen frames, a car will stop within X distance of another, etc. Next frame probability Scheherazade
- jxmorris12 5y agooh yeah, this will be crazy. DALL-E basically does text-to-image; there's a whole area of text-to-video that's working on exactly what you're talking about. There are some good examples from a recent paper here: https://video-diffusion.github.io/ https://video-diffusion.github.io/ they generate timelapses of fireworks, rivers, pouring liquids, etc. So it's a very good idea you had! ;-)
- ga_to 5y agoA short one sentence explanation what DALL-E _is_ would have been a nice inclusion. I guess it's an image generating AI thing?
- deadcoder0904 5y agoyes, you can read these blogs for more info: https://openai.com/blog/dall-e/ https://openai.com/blog/dall-e/ & https://openai.com/dall-e-2/ https://openai.com/dall-e-2/
- deadcoder0904 5y agoin future, movie posters, t-shirts, & so much more will be generated by dall•e. whoever is first-to-market with dall•e will skyrocket their business exponentially.
- mdp2021 5y agoEither in a very remote future, in which the AI will actually be an artist, and /understand/ and rival e.g. Saul Bass instead of mocking it, or sooner and be worthless (already the sheer hallucinations, revealing of the undepth, are quite evident) - in an historic context already overflowing of bad quality cheapery. The worth of making steps is in the preparation of further steps. Clearly we have not arrived.
- aimor 5y agoI'd love to see if DALL-E can generate cross-stitch patterns. Would be nice to be able to input a size and a theme and have something unique be generated.
- travelhead 5y agoI’m curious how difficult it would be to iterate this model into a VR Holodeck with spoken scenes, realistic movements, personality and behavior? Obviously this would be a huge AI undertaking but my prediction is 5 years.
- deleted 5y ago[deleted]
- walnutclosefarm 5y agoLesson one: nothing in which the text matters, as dall-e 2 clearly has no language capability at all. That the model didn't learn that words in the prompt are best transcribed is perhaps not entirely surprising, but it sure is glaring.