11 ms·
Nvidia releases Paint me Picture – A web app for GauGAN2
- monkeydust 5y agoWow. I have a good degree of respect for Nvidia but this should never have been released in the state it is. Whos the product manager for this?
- stefan_ 5y agoThis seems to be the link: http://gaugan.org/gaugan2/ http://gaugan.org/gaugan2/
- eis 5y agoA tip for people who get lost in the interface: 1. Just close the tutorial 2. Scroll down to the ToS checkbox and check that 3. On top in the "input utilization" row make sure only text is checked 4. Enter your text (use only landscape terms) 5. Press the arrow to the right inside a rectangle button located below the text input. 6. Maybe zoom out a bit because the result will be the image on the right which for me was out of view by default. Had to zoom to 50% to see the whole UI.
- mcintyre1994 5y agoAlso definitely don't hit enter like you do in every other form, because that seems to clear your input, swap the "input utilisation" back to only segmentation and sometimes also unchecks the ToS checkbox.
- ma2rten 5y agoThanks! This UI is something else...
- saberience 5y agoI only said lakes, mountains etc, and only got galaxy/star pictures... https://imgur.com/a/SiQwBA2 https://imgur.com/a/SiQwBA2
- Porygon 5y agoYou have to 1. uncheck "segmentation" 2. check "text" https://i.imgur.com/n9P8N3c.png https://i.imgur.com/n9P8N3c.png
- savant_penguin 5y agoTo whomever came up with this name, good job
- Porygon 5y agoThis sounds quite ironic to me, since "Super-GAU" in German stands for a disaster beyond all expectations (usually meltdown of a nuclear reactor). https://de.wikipedia.org/wiki/Super-GAU https://de.wikipedia.org/wiki/Super-GAU Another unfortunate name: "Gauleiter" was a regional leader of the Nazi Party. https://en.wikipedia.org/wiki/Gauleiter https://en.wikipedia.org/wiki/Gauleiter
- Tade0 5y ago"gaugan" sounds like the word for "rag" in Polish.
- eis 5y agoI am just getting very weird results that don't look at all like the one in the demo video. Here for example the image it gave me for "car in front of house" https://i.imgur.com/QdtrtCR.png https://i.imgur.com/QdtrtCR.png Or how about this one for "dog playing with ball" https://i.imgur.com/ldGLdwF.png https://i.imgur.com/ldGLdwF.png I have tried about a dozen different input phrases and every time I get these very strange results.
- guerrilla 5y agoWell, you did better than I did. I only get pictures of stars and galaxies regardless of what I input, even restricting it to landscapey words.
- dd444fgdfg 5y agowhat? are you saying they showcased the best results? that's unheard of.
- eis 5y agoIt's not just a matter of showcasing the best results. It's a matter of night and day difference between normal output and the one showcased. They are not even remotely close. I actually wonder why they decided to release this to the public in its current form. I was very impressed by the noise suppression app they released so I expected something that delivers decent results.
- codefreakxff 5y agoCars and houses don’t sound like landscape. Maybe they should put some filters for non landscape input
- eis 5y agoI missed the part where it said it was trained only on landscapes. So I retried it with just those and got this: "river flowing through desert": https://i.imgur.com/QSjH5hk.png https://i.imgur.com/QSjH5hk.png "sunset waterfall": https://i.imgur.com/wS3EEci.png https://i.imgur.com/wS3EEci.png Or how about a lovely "green shoreline": https://i.imgur.com/RkbTV99.png https://i.imgur.com/RkbTV99.png
- blt 5y agoI entered "kitten" and got typical surreal GAN output with disconnected topology, dozens of eyes, etc. Edit: Looks like it was only trained on landscape images.
- carrolldunham 5y agoI finally got through to the demo through three links and it's so busted in so many ways for me that I give up. Maybe it's stupid to try with my old netbook but I don't get any indication of whether I need a fancy graphics card for it to work or if it's running on my end. Anyway -the screen zooms around disorienting for the tutorial and I get to congratulations you made your first image - there's nothing there. -Exiting the tutorial, checking 'text' instead of 'segmentation' just immediately switches back after entry -The whole site is a fixed width which is wider than my screen - A red alert check box at the bottom confuses me about whether that's why it's not working etc
- Turing_Machine 5y agoMore or less the same, and I have a nearly-new M1 iMac, so it's not your old netbook. Chrome appeared to work somewhat better than Brave, but it was still pretty frustrating. I did manage to get it to work in a half-assed manner eventually, but the UI definitely needs a great deal of work.
- webmaven 5y ago> Exiting the tutorial, checking 'text' instead of 'segmentation' just immediately switches back after entry That tripped me up too. After typing in your text, don't hit enter or anything similar, just click or tap the button with the right arrow (or anything to the right of that button, effects vary).
- AbuAssar 5y agoLink to actual demo: http://gaugan.org/gaugan2/ http://gaugan.org/gaugan2/
- akersten 5y agoI really don't have anything constructive to say. I think in general we're getting too soft on shitty things, so I'm going to be harsh. I clicked through to the demo site ( http://gaugan.org/gaugan2/ http://gaugan.org/gaugan2/ ) and it was horrible. The interface is clunky, slow, and confusing. I actually had to zoom out in my browser to see the whole thing. Had to click through a non-HTTPs warning. The onboarding tutorial is pretty bad. I got a generic picture of the milky way for any prompt I tried ("rocks", "trees"). If you press Enter in the prompt field it refreshes the page. This feels like a hackathon front-end hooked up to an intro to PyTorch webservice. It's only neat because, unlike the other 20 copies of this same project I've seen, it was the only one that didn't immediately throw its hands up and say "server overloaded, please wait." If I'm meant to be impressed or fearful of "big data deepfake AI," this isn't it. [0] https://imgur.com/BNLDt6A https://imgur.com/BNLDt6A
- Imnimo 5y agoIt looks like you have selected for it to use a segmentation mask, and not to use text.
- akersten 5y agoI have no idea what that means, but the fact that it both told me to enter a text prompt and actually let me do it while not being in whatever magical mode it should have been in in order to actually use the text prompt is another point that can be added to my above rant. Alright, I've uttered the incantation for it to do the thing. I still don't get it. [0] https://imgur.com/4zbaiH0 https://imgur.com/4zbaiH0 I also tried another example prompt, which bared a striking similarity to the previous result. I don't know if it's persisting the result (It shouldn't - I didn't click the re-use image button), but the strange life-raft looking artifact is very persistent. [1] https://imgur.com/KTCM4xH https://imgur.com/KTCM4xH
- Imnimo 5y agoYeah, the text-to-image seems to be highly dependent on whether the generator knows how to generate the specific objects the text model thinks should be in the image. I got much more consistent results using the semantic segmentation drawing as input: https://imgur.com/QC13zml https://imgur.com/QC13zml (and for what it's worth, you're totally right that the UI is just an absolute disaster)
- saberience 5y agoI entered "mountains" and "mountains and lake" and only got pictures of what looked like blurred galaxies and stars. Clicking any of the style buttons got me colored/tinted pictures of stars. Is it broken? https://imgur.com/a/SiQwBA2 https://imgur.com/a/SiQwBA2
- luegen 5y agoYour segmentation map contains "sky" by default. Try drawing "mountain" color in the lower part of the image first.
- Baeocystin 5y agoI like what it did with colorless green ideas sleeping furiously. It fits the mood of the sentence. https://i.imgur.com/jPd0QLE.png https://i.imgur.com/jPd0QLE.png
- King-Aaron 5y agoTrying to do everything that the tutorial and other commenters have suggested, but when I click the arrow button it just waits for a few moments and nothing is generated. Am I missing something?
- system2 5y agoAfter trying 30 minutes I kind out understood some stuff. But the ui is legit anxiety inducer. I hope they can fix the ui to make it fun. Currently felt like using 80's DOS graphic software with so much manual input.
- blackoil 5y agoI am impressed, obviously still a tech. demo but I like the future. text to image isn't awesome but segmentation worked beautifully https://imgur.com/a/VSv9ZbA https://imgur.com/a/VSv9ZbA
- thuccess129 5y agoNvidia should visualize a periodic 24 hour 3D landscape sweep of the chatter on social media platform for metaverse dive through and interactive engagement.
- poniko 5y agoThe UI is horribel .. they don't have one single ux person who have 2 hour to spare that could help out at nvidia ...
- ribit 5y agoAre there any open-source models that can do similar type of landscape generation? I would really like to look at the code and try to understand how these things are built...
- quitit 5y agoThis might be a good start: https://thisbeachdoesnotexist.com https://thisbeachdoesnotexist.com There are a whole series of "this<blank>doesnotexist" E.g. landscapes, faces, animals, etc.
- nitred 5y agoI wonder if in a decade or so, large tech companies will unseat Disney, Warner Brothers etc as creators of animation movies. While the results on Nvidia's website aren't too impressive, if you look at the history of animated movies [1], one can see how trivial and simplistic the art and animation was. Having had some experience doing some research on GANs at university, I know them to be very powerful. What's very important to note is that the images generated my the model are truly "novel" i.e. completely fictitious. The images generated may be biased to some of the training data such as color and texture of the water and rocks for example, but every image is a fantasy of the model. The only way the model can generate such realistic images is because it has a very good abstract internal representation of what oceans, waves, rocks are. Back at university, I pitched the idea to my professor of using GANs for generating "novel" images in real time while parents would read bed time stories to children. I didn't get very far. Glad to see some real progress in that direction. [1] https://www.filmsite.org/animatedfilms.html https://www.filmsite.org/animatedfilms.html
- pjmlp 5y agoHardly, Disney now owns Pixar after the early 3D competition days, they can as easily buy another concurrent.
- f0e4c2f7 5y agoClose, but it will actually turn out to be a very small company (possibly in less than a decade). Hollywood has little awareness of just how much danger the legacy version of their industry is in. ML generated assets are slowly creeping towards reality and at the same time doing 3D dev is 100-1000x easier than it was just a few years ago. It's now possible to do for free in many cases as well.
- edumucelli 5y agoI input "a horse", it gives me this: https://imgur.com/1coGQix https://imgur.com/1coGQix
- dt3ft 5y agoBehold, AI. I think our dev jobs are safe for the next 100 years at least.
- Havoc 5y agoWhat license are the produced images under? I could see this being used for cheap stock photos
- Tade0 5y agoMtG dual-color lands serve as a good source of ideas on what to put in the textbox: https://www.mtglands.com/coloridentity-dualcolor.html https://www.mtglands.com/coloridentity-dualcolor.html As for the UI: layout via tables?
- xdfgh1112 5y agoFeeding all magic cards into a GAN would be a great way to generate new ones.
- jeroenhd 5y agoThe UI for the demo is atrocious, but that's probably because the text-to-image generation was glued to their existing AI painting tool. I'd love for just the algorithm generation tool to be available for download. The web UI is clunky and just doesn't seem to work right.
- h2odragon 5y agoI hear they have a miraculous new AI tool that magically determines your sexual desires then uses lasers to induce those feelings through your eyeballs with no contact necessary! Coincidentally demonstrated at this very same URL! Even then, I don't think I'd care enough to fight through the layers of bullshit here.
- bradhensen 5y agoNow, it's not an imagination if you can create a visual art using texts.
- togaen 5y agowhy
- bliss 5y agoI sit here quite impressed with my Pseudo 50s SciFi book cover https://imgur.com/a/NZuGTXU https://imgur.com/a/NZuGTXU However... This gallery on imgur gives a better idea of capability https://imgur.com/gallery/coWN44P https://imgur.com/gallery/coWN44P
- deleted 5y ago[deleted]
- deleted 5y ago[deleted]
- stunt 5y agoIt seems that the web UI was generated by AI too, because it's really hard to make sense of it.
- greenseagull21 5y agoThe comments are overwhelmingly critical of the user interface, which is undoubtedly the weak part of this release, but I was still able to get some very impressive results. An AI generated house on a lake: https://imgur.com/a/0wtVKum https://imgur.com/a/0wtVKum I have found the best results come from uploading an image, then using the demo tools to get a segmentation map and sketch lines, then editing those as you desire. Changing the styling at the end also makes a big difference!
- wodenokoto 5y agoChose building->house, segmentation and text, wrote "skyscraper" as text and drew some lines of a silhouette of a skryscraper. Returned an image of stars in outer space.