17 ms·
DALL·E: Introducing Outpainting
- zoba 4y agoI have been working on an outpainting piece (in Photoshop) currently 10609 x 8144. I am very pleased to see more support for this, though hoping it doesn't kill my current flow. Seems like it is currently not working on their site.
- O__________O 4y agoThis was already possible with DALL-E using the inpainting feature going from defined image to transparent edge; this just automates what was a manual process before. Do wish the inpainting tool had more options, for example to fade a transparency in, since my understanding is it makes a difference; not to mention magic wand selection/deselection tool. In case it is not obvious, every time a user generates an additional section of an image using the outpainting feature, it costs a credit.
- ShamelessC 4y agoAutomation of manual processes is generally useful.
- pilotneko 4y agoMaybe kludge it with a dithered transparency mask?
- O__________O 4y agoOnly matter of time before Adobe adds inpainting with hooks to local or API generative tools, using OpenAI to edit works like this is like transporting back to past using basic image editing tools.
- ml_basics 4y agoYes indeed, and it shows the advantages of Stable Diffusion's model of just releasing the model and letting people do what they want with it - this was straightforward to implement oneself. And while OpenAI released this feature now, it's probably just a matter of days until even better features built on Stable Diffusion will be released, given how much community energy is focussed on it right now.
- dangero 4y agosimilar work using Stable Diffusion in a Photoshop plugin: https://old.reddit.com/r/StableDiffusion/comments/wyduk1/show_rstablediffusion_integrating_sd_in_photoshop/ https://old.reddit.com/r/StableDiffusion/comments/wyduk1/sho...
- rvz 4y agoSo DALL-E is already old news and the Stable Diffusion ecosystem is once again already ahead especially with this announcement. Quite funny to see OpenAI panicking and falling on their own sword, as they were supposed to be 'Open' in the first place and are now being disrupted by open source.
- sroussey 4y agoI came to say something similar. It feels like “OpenAI” was just a trademark grab to prevent others from using it. Of course, all conspiracy theories work well when looking backward in time.
- Blackthorn 4y agoCouldn't happen to a more deserving group of people. Good riddance. Squatting the name "open" and trying to reap the benefits therein while being anything but.
- msoad 4y agoThis is cool and useful! Putting "Girl with a Pearl Earring by Johannes Vermeer" in the kitchen in 2022 does not look good!
- i_like_apis 4y agoBecause depicting a woman in a kitchen is perpetuating the pernicious male patriarchy? Sorry we're not doing that. You might find some reception for this sort of thing on Twitter though.
- dymk 4y agoIt's 2022, women are allowed to enjoy cooking and baking just as much as men are.
- astrange 4y agoIt's an open-concept home. It's chic.
- npteljes 4y agoWhat makes you think it's a kitchen? It looks more like a thrift shop, or a store room to me.
- naillo 4y agoI can't help but feel like they're adding this at this particular point since Stable Diffusion has announced they're releasing their 'inpainting' model next week.
- deleted 4y ago[deleted]
- i_like_apis 4y agoI really doubt it's related at all, though everyone would think it looks that way. SD has only been out a week and this feature would have taken much more than that to build, test, enroll demo users, make a webpage for, etc.
- naillo 4y agoI can't prove it of course but it wouldn't surprise me if they had this pretty much done already long ago (dall-e has been out for several months at this point). The actual implementation doesn't look like it'd take more than a few days to code honestly (and they've got quite competent coders over there). Only speculation of course.
- i_like_apis 4y agoEverything looks easier when someone else is doing it.
- bob1029 4y agoHow long until we can run this over shows like Star Trek Voyager/DS9 and Seinfeld to achieve believable 16:9 scenes?
- cesis 4y agoNext week?
- deadbunny 4y agoSomeone has been upscaling DS9 already[1]. Obviously not release anywhere. Not sure I'd want them in 16:9, hd 4:3 like the other HD releases of TNG and TOS would do me. I understand they shot on video so an official true HD remaster is likely to never happen. 1. https://www.extremetech.com/extreme/324466-tutorial-how-to-upscale-star-trek-deep-space-nine https://www.extremetech.com/extreme/324466-tutorial-how-to-u...
- jefftk 4y agoDS9 shot on film: https://news.ycombinator.com/item?id=19454370 https://news.ycombinator.com/item?id=19454370 But it did use a lot of early CGI that would need to be redone.
- henriquecm8 4y agoI don't have a deep understanding of how training models work, but I wonder if training a model with every frame of TNG and then outpaint it into 16:9 would work.
- russdill 4y agoTemporal coherence will still take a while to solve but it's not undoable. Making things that look correct upon closer inspection rather than just looking "nice" will probably take some degree of human curation for quite a while.
- dr_dshiv 4y agoAnyone working on closed caption models at the moment?
- bottlepalm 4y agoFeels like a race to the bottom. More features, lower cost, every week. No idea where it’ll level out, but I like it. Just bought some more Dalle credits today because it’s so much fun. This is a revolution in ‘art technology’ it’s like Steve Job’s bicycle for the mind. Best I could do a month ago was a stick figure in MS Paint, but now..
- have_faith 4y ago> Best I could do a month ago was a stick figure in MS Paint That is still the best you can do... which happens to be about the best I can do! Just like my introduction to the computer at a young age has atrophied my handwriting quality.
- bottlepalm 4y agoI guess if we’re going to get into semantics and the definition of self, where does the ‘I’ end and something else begin then I don’t really do anything. You could also say I can’t walk either without the ground.
- dougabug 4y agoI think he’s calling you a cyborg.
- have_faith 4y agoI was just being needlesssly pedantic. I guess it's a spectrum from "I painted the mona lisa" to "I pushed a button and a mona lisa appeared". That's a very individualistic view also though, maybe the thousands of programmers than commited to the thread of history that arrived at you pressing the button are part of the art performance.
- astrange 4y agoJust switch to a PalmPilot.
- tough 4y ago> it’s like Steve Job’s bicycle for the mind I have been thinking the same thing, it's sad Steve will not be able to see it
- minimaxir 4y agoAlso per the email release, variations/inpainting, the trick used to simulate outpainting before this, now generates 4 images like a normal DALL-E generation instead of 3 (which was arbitrary anyways). I do wonder how expensive the outpainting is. I'm assuming that each additional step in the timelapse is a full generation, in which case ~15 generations is about $1 total.
- aantix 4y agoWhy would Google hold back on releasing Imagen if there are competitors that are publicly available already? Imagen isn't special anymore.
- aabhay 4y agoGoogle is most interested in maintaining mind-share so that researchers don't jump ship. They could always monetize Imagen through Google Cloud but are concerned about risks (NSFW, legal issues, bias, etc.) so would rather wait for others to step into the water first.
- jsnell 4y agoA few possible theories, some might be mutually exclusive: Organizational scar tissue making them more risk averse about the PR risks of letting the genpop use AI generation tools, and create something offensive. With the safe assumption that Google will get blamed, not the user. Fear of government regulation on AI if they don't self-regulate. No need to actually release it, since this isn't the core business but just research. (While openai needs to actually create the business.) Corollary: more to lose -- a scandal around offensive content will not hurt openai's non-existent other businessess. It might make some advertisers pull their ads from Google. The opportunity cost of building a self serve platform is too high. (Can't pull in people writing those kind of apps from projects with more commercial importance. Can't make the ML researchers do that.) They misjudged how much demand there would be, and thought that building a platform would not be useful for a few years. And if it now turns out to actually be a great business it'll now take them a year to productionize and build a platform. Their compute requirements are so high that selling access is not viable, the costs are prohibitive for real users. It's not that different from e.g. self driving cars. Pretty obviously they had better tech from early on, but were not willing to take the risks that Tesla was.
- danpalmer 4y agoNo one has actually figured out a business for this yet. Sure people are paying small amounts to play around with DALL-E, but it's not a business model, it's basically just a subsidised tech demo at the moment. What will the business model actually be? I imagine there's a market for a stock-photo style service that has a very large number of good images for very diverse topics, but DALL-E etc are a bit low level for that, there's a lot of product development that needs to happen on top of that. A stock photo service doesn't seem to be the sort of thing that Google would get into. Maybe it's an art-helper plugin to image editors? The Stable Diffusion based plugin sounds promising for this, but will _artists_ want to use it? Surely the point of art is (except for art making A Point) that the artist produced it with their talent? If you're not trying to make Art then maybe you need the stock photo service. Perhaps I'm just not very imaginative, but I can't think of any use-cases that aren't either extremely niche, or are better served by a higher level style service that happens to use a model like this under the hood.
- rw2 4y agoDoes the new generated picture take into account of all previously generated image or just whatever is around the square, the first is amazing, the latter was a feature that was already there. Regardless, this is a great way for people to fight the lack of detail in Dall-E which I think is one of it's largest flaw.
- aabhay 4y agoJust what's in the square I believe. The only difference here is one of UI, since they give you a canvas in which to place your generations.
- dinobones 4y agoAnd every time I drag that little square reticle to fill in a 128x128 patch of an image, you can be sure it'll be a 15 second API call that I'm charged $0.25 for. Yipee! Very open.
- oldstrangers 4y agoDo you expect them to provide computing power for free?
- netr0ute 4y agoWhy can't we provide it ourselves and skip the middleman?
- deleted 4y ago[deleted]
- rngname22 4y agoNo one is stopping you?
- password321 4y agoDalle is currently a cloud only service. How behind are you?
- rngname22 4y agoOh sorry, didn't realize you wanted them to develop the model for you. And give it to you. I meant no one was stopping you from building what you want for yourself.
- baq 4y agoSir can you point us to the weight url for dalle?
- 4y ago
- siavosh 4y agoA few weeks ago I was skeptical that this technology would get past the emotional response we get from procedurally generated game environments, but I've been convinced otherwise. The emotional response I get from some of the best of these images are novel and thought provoking. Makes me wonder what percent of what makes us human is now algorithmically solved....
- maxwell 4y agoMaybe. I've been often reminded lately of Herbert Goldstone's "Virtuoso" (1958): http://elateachers.weebly.com/uploads/2/7/0/1/27012625/virtuoso.pdf http://elateachers.weebly.com/uploads/2/7/0/1/27012625/virtu...
- sleepdreamy 4y agoWe still know basically nothing about our Brain/Consciousness. I would say we have a lot more to explore/research
- mensetmanusman 4y agoOur brain is apparently just a 4 gb large arrangement of electrical weights.
- d23 4y agoNot to be pedantic, but we have on the order of 100B neurons, and afaik each of them can be connected to thousands of other neurons. I assume we probably have a ways to go before we're encoding the amount of information a brain can comprehend.
- astrange 4y agoAlso, your brain knows how to look up things in external storage, but ML models have to keep everything in their weights even if it's not a good fit.
- aidenn0 4y ago
- affgrff2 4y agoEveryone says stable diffusion is a free alternative. Where do I get the weights without passing a gatekeeper?
- dceddia 4y agoThey're currently hosted on Google in a way that you can download them via curl/wget. Here's a guide including the link: https://www.assemblyai.com/blog/how-to-run-stable-diffusion-locally-to-generate-images/ https://www.assemblyai.com/blog/how-to-run-stable-diffusion-...
- dsmmcken 4y agoThe UX is evolving around AI image generation so fast, everyday is something new. There's so much greenfield exploration space for new interaction models. 6 months from now, how we interact with these models will probably look entirely different.
- fleddr 4y agoComments made just 3 days ago, "well...it can't do that", are already obsolete. I've never seen innovation at this breakneck speed. We're talking a WEEK since release.
- TekMol 4y agoIs it broken right now? Makes my fans spin but it never finishes.
- ckluis 4y agoI think Dall-E would benefit from a "sketch-based" prompt in addition the text based. This was mindblowing - https://andys.page/posts/how-to-draw/ https://andys.page/posts/how-to-draw/
- teddyh 4y agoSomeone should name the next image generator OWL, since it “draws the rest of the owl”.
- boppo1 4y agoCheeky: https://github.com/hlky/stable-diffusion-webui/blob/master/images/img2img.jpg https://github.com/hlky/stable-diffusion-webui/blob/master/i...
- teddyh 4y agoI thought it was odd that I hadn’t seen anyone else make that joke. Turns out they had, I just hadn’t seen it. Thanks! Reference, for those who haven’t seen the original joke to which my joke was referring: https://www.reddit.com/r/pics/comments/d3zhx/how_to_draw_an_owl/ https://www.reddit.com/r/pics/comments/d3zhx/how_to_draw_an_... (See also: https://knowyourmeme.com/memes/how-to-draw-an-owl https://knowyourmeme.com/memes/how-to-draw-an-owl)
- sho_hn 4y agoIt does feel like art's disruptive "Calculator moment" is happening where you can now leave a lot of basic/mechanical tasks to a tool and give more focus to higher-minded problems. It's going to get so cool and interesting, I think. A lot of the conversation around art may focus more on composition and objectives of the artist in the new prompt engineering world, with less bias from factors such as rendition quality etc. creeping in since it's so incidental. New forms of art will emerge and/or gain popularity that focus on trying things the tools aren't good at yet. The human artist of the gaps. The niches will constantly be shifting. I wonder if we'll learn to recognize the output of certain popular models and perceive them as instruments. "Made by xy on z" instead of "xz on guitar", so to speak. I remember the 90s/early 00s internet when it was always easy to tell when something had been done on Flash, just because of its line anti-aliasing rendition style being so distinct and familiar. The novelty will wear off, and we'll all start to feel a bit disappointed that the average human's imagination is pretty limited and novel/original ideas remain somewhat rare as the patterns and tropes in all the generated art emerge. It's great you can put the space needle where you want it and get a good-looking city and space ship, but how many variations of a cyberpunky skyline with a space ship do you need? And then we'll celebrate the novel stuff that does happen, as always. I suppose the tropes will evolve faster as the throughput goes up.
- deleted 4y ago[deleted]
- thebeastie 4y agoThis is moving fast ! Obviously, it’s going to be an incredible boon for content creation. I suppose that in the future it’ll make creating videos an order of magnitude easier, which will allow a single person or a small team to make a high quality movie where all the assets are generated, so that’ll really give us an eye into a lot of people’s imaginations, for better or worse. To leave a thought provoking example, what’s going to happen when every adolescent has the ability to make a convincing deepfake? It’ll put nation states in a similar position than they already have with crypto, where they wonder if they should ban, or regulate… doing nothing wont be an option.
- woeirua 4y agoMeanwhile someone has already built a photoshop plugin for Stable Diffusion that you can use today to do basically the _exact_ same thing: https://old.reddit.com/r/StableDiffusion/comments/wyduk1/show_rstablediffusion_integrating_sd_in_photoshop/ https://old.reddit.com/r/StableDiffusion/comments/wyduk1/sho...
- nabakin 4y agoDoesn't make sense to me why OpenAI has kept DALL-E closed source for so long. I can only guess either safety from misuse or leveraging it for money. At this rate though, Stable Diffusion is going to dwarf it
- amelius 4y agoWasn't OpenAI supposed to "democratize deep learning"? It seems more like they were trying to accomplish the opposite.
- wahnfrieden 4y agoIt's in their interest to posture that way publicly while controlling scarcity of access where there's financial upside to
- thethimble 4y agoExclusively licensing GPT-3 to Microsoft seems like a clear example of this. https://www.technologyreview.com/2020/09/23/1008729/openai-is-giving-microsoft-exclusive-access-to-its-gpt-3-language-model/ https://www.technologyreview.com/2020/09/23/1008729/openai-i...
- visarga 4y agoElites for democracy! With their elite studies and abilities they will democratise AI by teaching it what is right and wrong. They already know better than regular people and AI. And being so open they first lock the model up and charge a fee, so anyone can pay. Just spreading democracy through paid API calls. /s I was a bit mean, they did kick the field in the butt and pushed us ahead even with all the stubbornness and secrecy. But now they are just holding us back.
- EddySchauHai 4y agoDo you reckon we will have Prompt Engineers who are skilled at getting AI to generate what they want before long?
- benreesman 4y agoSo... are we done politely coughing and looking out the window at the idea that the gatekeeping was motivated by altruism so that we can move on and just use this much better innovation model going forward? Various (subjectively judged) SOTAs on at least some subset of at least this family of tasks is changing somewhere between daily and hourly right now. I've been watching this stuff closely since fairly early ImageNet days and I've never seen a Cambrian explosion of "how the hell did that do that?" events at anything like this cadence.
- civilized 4y agoIf you're talking about scientific gatekeeping like pre-publication peer review, the gatekeeping was never really the root problem. If researchers have great products or findings to show off, it's easier than ever to simply publish them somewhere online and let impressed audiences spread the word. Gatekeepers have been irrelevant to truly great science for a long time. It's mediocre science that needs gatekeepers to distinguish it from not-even-mediocre, truly substandard research.
- theptip 4y agoThe gatekeeping GP is referring to is OpenAPI keeping DALL-E 2 behind an invite-only API, with weights unpublished, vs. Stable Diffusion publishing the whole model for anyone to download and use.
- benreesman 4y agoIn fairness OpenAI aren’t the only ones to use fairly thin logic to avoid saying “this is about money”. Everybody was doing that until roughly, now. They’re just the only ones calling themselves “OpenAI”.
- astrange 4y agoI cannot get this to work properly (in Safari). It just won't regenerate anything above or to the left of the image; it acts like I selected the opposite sides if I try it.
- astrange 4y agoLooks like they pushed a fix. Now I'm getting funny "you get what you asked for" issues; if my prompt mentions a face, then using outpainting to create a 16:9 background behind it doesn't work so well - it just starts making more faces.
- zegl 4y agoThis is great news! I spent multiple hours doing this exact thing by hand only last week when creating new graphics for codeball.ai.
- NIL8 4y agoI love this idea of extending the canvas to build out the scene. It makes me wonder if anyone's tried using Poe's stories for illustrating with AI? His descriptive writing style seems ideal.
- AJRF 4y agoThe scrambling to stay relevant after Stable Diffusion is very very enjoyable to watch.
- amilios 4y agoDamn, Dall-E really lost its competitive edge overnight when Stable Diffusion was released. They dropped their prices across the board in response, but honestly I think it still isn't enough to save them. The magic of open-source competition.
- actusual 4y agoLol I just want to be able to use the thing. How long is this waitlist?
- istsp 4y ago
- jatins 4y agowhat kind of prompting is required for this? I uploaded a digital painting, selected "Edit mode", added a generation frame and prompted "complete the painting in frame" ...but it just added a completed unrelated photo related to painting in that frame.
- d23 4y agoI guess prompting that is "similar" to the image. The output mine gave was pretty lackluster. I had to overlap the image significantly, and even then it didn't seem to take into account enough of the context to make something that resembled the style close enough.
- jatins 4y agoYeah, you have to first describe what the image is supposed to be and then it picks it up from there. Got some good results with digital art.
- hey_bear 4y agoWhile maybe not "as good as a human" creatively, wonder when this matures a little more, we'll see whole art/design departments go to the wayside and be replaced by stuff like this...
- eshack94 4y agoHow does Stable Diffusion compare to DALL-E in terms of features/capabilities? I've used DALL-E/DALL-E-2, but have yet to try Stable Diffusion. Can someone give me some insight?
- coolspot 4y agoSD is very capable, especially considering it runs on like 6GB of VRAM (we don’t know on what A100 96GB VRAM clusters DALL-E runs), but you will need to be more specific with your prompts to achieve comparable results. Img2img mode where you provide SD a sketch and a textual description of what you want to achieve abd it figures out result is a killer! https://www.reddit.com/r/StableDiffusion/comments/wzlmty/its_some_kind_of_black_magic_i_swear/ https://www.reddit.com/r/StableDiffusion/comments/wzlmty/its... Krita plugin: https://www.reddit.com/r/StableDiffusion/comments/x209sb/preview_of_next_feature_of_my_stable_diffusion/ https://www.reddit.com/r/StableDiffusion/comments/x209sb/pre...
- eshack94 4y agoThanks for the info. I'll check it out. Img2img mode looks incredible.
- GalacticWarlord 4y agoI would like to see Stable Diffusion and DALL-E to work with words instead of images. Go from Hello to any topic, and see how it responds. Trained on everything ever written. Seems like it would/could generate realistic discourse. Is that possible, to work with words instead of images?