7 ms·
Using Stable Diffusion's img2img on some old Sierra titles
- vslira 4y agoIs there any service offering user-friendly access to open source DL models? Paid is fine.
- fragmede 4y agohttp://beta.dreamstudio.ai http://beta.dreamstudio.ai is the official paid Stable Diffusion webUI.
- Silverback_VII 4y agoI liked it until I noticed that it costs me $10 a day. I'm also not sure if they support img2img. I have used huggingface and then replicate for it(NSFW filter is very annoying).
- skybrian 4y agoUnless you’re looking at something else, it’s not per day, it’s a credit system that amounts to about 1 cent per image. How many images do you plan to generate a day?
- Silverback_VII 4y agoyes, it's per image but for some reason I easily rushed through the 1000 generations in one day.
- MattRix 4y agoWell you’ve gotta either run it locally or pay for it. The GPUs this stuff runs on are too expensive to offer unlimited use for free.
- Silverback_VII 4y agoI'm not against paying but it should be somewhat raisonnable. to put things into perspective: Colab pro only costs about $10/month and you will probably be able to generate at the same speed.
- MattRix 4y agoFor uses like that Colab costs Google more than they earn. It would make no sense to base a business around that model.
- skybrian 4y agoI did too, but I bought another 1000 generations and haven't run out yet. Many days I don't use it at all. I like it better than a monthly subscription like MidJourney.
- cercatrova 4y agoJust use Google Colab, it's free indefinitely because Google is paying for it.
- fassssst 4y agoMidjourney uses Stable Diffusion now too in their beta version.
- adammarples 4y agoThe stable diffusion repo itself is free, and you can get the model from hugging face, also for free. Runs on my 1070 easily.
- gibbonsrcool 4y agoIf you have over 4MB VRAM you can run it locally. I've been experimenting recently and find that even with 10MB VRAM I can only get 256x256 resolution images. I have a Dockerfile I can share that packages up the install process and removes censorship if anyone is interested. I find the censoring is extremely conservative.
- arthurcolle 4y agoPlease do share. I did the same and have it but having trouble deploying it to a prod GPU server, still figuring it out.
- gibbonsrcool 4y agoHere you go: https://gist.github.com/gvbl/9231406c54e7c9fd37abdfa6c697fe5f https://gist.github.com/gvbl/9231406c54e7c9fd37abdfa6c697fe5... You can run it with a command like this (I'm on windows): docker run -it -v <model file path>:/stable-diffusion/models/ldm/stable-diffusion-v1/model.ckpt -v <outputs folder>:/stable-diffusion/outputs -v <inputs folder>:/stable-diffusion/inputs -v <cache folder>:/root/.cache --gpus all knightley python /stable-diffusion/scripts/txt2img.py --W 256 --H 256 --prompt "a horse wearing a top hat" assuming you build the image and tag it "knightley"
- iforgotpassword 4y agoHuh, I've been using the docker container by cmd2 and been doing 512x512 just fine with 8GB. Are you on Windows by any chance?
- gibbonsrcool 4y agoYes, windows with a RTX 2070 Super. The logs say the app is trying allocate just a few hundred MB more than what I have. I'm reasonably happy with 256x256 for now, just messing around.
- terrio 4y agoAwesome! I thought about this in a slightly different way: D2 remastered has a great switch back feature. You could easily train a network with tons and tons of D2 old vs. New and just use it to Auto upscale /reimagine of old D2. Image rendering a old D2 video into 4k D2 remastered style.
- yummybear 4y agoAwesome, but it’s totally missing the atmosphere in the originals imo
- iforgotpassword 4y agoI found the intro of one of the kings quest games run through SD a few days ago, but can't seem to find it now. It wasn't that impressive since I guess there wasn't much fine tuning going on, but I liked the general idea. It had a few funny hiccups, but I'd have expected much more erratic behavior, because there is no information shared between frames (I guess). But maybe this concept can be improved upon?
- davesque 4y agoGoing to have to be the naysayer here. First, I'll say the simple fact that Stable Diffusion produces anything coherent is incredible. I'm blown away by the tech. However, my honest opinion of the results showcased in this article is not positive. Many of the result images contain bizarre distortions or dreamlike artifacts that severely disrupt the flow of the image. Especially the first one. It's clear that there's something like a person with long hair standing in front of a peak shrouded in clouds. But it only takes one or two moments to see the flaws in the output. I wonder if hyper parameter tuning would help. Again, I think the results are impressive in their own right. But they seem impractical on account of the flaws in the details.
- jamiek88 4y agoWeird until I read your comment I was blown away. Then I had another proper look at the first image and in many ways I had to turn off my brains amazing ‘upscaling’ ability. My brain had upscaled that human like blob to a woman spinning around with a sword so her hair covered her face. Looking closely. None of that is there really, just a suggestion of it. And that is enough. The more I learn about vision and sight the less I’m sure that we see reality.
- 5d8767c68926 4y ago>Looking closely. None of that is there really, just a suggestion of it. In contrast to the photorealistic pixel art?
- fezfight 4y agoExactly, these complaints are insane given that the source is 8 colour pixel art.
- LocalH 4y agoWe see reality in some sense - light of various wavelenghts reflects off physical objects and enters our eye. However, our processing and subjective interpretation of the input is what can be more subjective, because every person's brain is going to process such items differently based upon experience (especially early life experience, when our brains are the most plastic). Also, some people have sensory differences (such as color blindness) that can influence the processing of the light that enters our eye. Objective reality exists, for some definition of "exists" - there is physical matter present, with properties enabling some or all wavelengths of light to reflect (and similar for other senses like hearing). However, if we viewed reality devoid of the subjective processing, we'd "see" everything, but key existential concepts such as object permanence would not be possible, as that requires our brain be able to process and recognize an object in order to identify what the object is in the first place, to even be able to remember what it is. Not entirely unlike the iterative process of modern machine learning.
- avidphantasm 4y agoYeah, it’s amazing that things like Stable Diffusion can make coherent looking images. But why? Why convert iconic EGA and VGA *art* into algorithmic representations? To me, it doesn’t improve on the originals in any way. I would never play a game with the graphics replaced by these. To me, it is the constraints of older technologies that led artists to create imaginative works that transcended the materials available (big pixels with a limited palette) and helped create worlds where your own imagination could run wild. Replacing these images with photo realistic Thomas Kinkade-esque treacle is an abomination.
- MattRix 4y agoWhy do people always ask “why?” on these things? Not everything has to be “useful” or have commercial value. The original games aren’t going anywhere. People just enjoy doing this kind of stuff, pushing the technology to make interesting things.
- avidphantasm 4y agoI’m not criticizing it because it’s not useful. I’m criticizing it because it is not art, and it is anti-humanist.
- MattRix 4y agoOf course it is art. The thing that makes it art is the human thought process and intention, regardless of how the final result turns out.
- avidphantasm 4y agoOh, and the pictures look like shit.
- ben_w 4y ago"""At the 1983 Academy Awards, Oscar voters declined to nominate [Tron’s] pioneering special effects. Lisberger said it was because they felt using computers as an animation tool was cheating.""" - https://www.moviefone.com/2017/07/08/19-things-you-never-knew-about-disneys-tron/ https://www.moviefone.com/2017/07/08/19-things-you-never-kne...
- decibe1 4y agoThis is really timely - I just started to replay some of my favorite Sierra titles "Hero's Quest". 1 and 2 (unofficially) have VGA ports that updated the graphics. So, I may have to run some screen shots through to get an even newer backdrop.
- holoduke 4y agoWonder if one day we can do realtime video conversion with this tool on a phone using the camera. We be mind blowing to see it live in action and changing your backyard in any style you like to see. Maybe even with VR. Ultra tripping experience. I guess we have to wait 5 to 10 years
- ben_w 4y agoSomething like this, but with an automated flow?: https://twitter.com/karenxcheng/status/1564635828436885504 https://twitter.com/karenxcheng/status/1564635828436885504
- z9znz 4y agoThe before and after are great. There is an art to conveying a feeling with limited resources. That's what makes early computer game images (the good ones... because there were plenty of bad ones) so special. The same could be said even more strongly for words. I'm not a writer and I don't remember everything, but someone famous once said something about eliminating everything non-essential from writing to make it better. That's what makes a writer really great. Even so, the AI-upscaled versions of the original art are impressive. I said it before on this topic, and I'll repeat it. We will someday (soonish) have games where the art is generated in real time, unique for each player, based on good inputs. And it will be awesome. Every play and every experience will be relatively unique, but most or all of the plays will be excellent. That's an exciting prospect.
- Bakary 4y agoWhy stop at the art? We'll have unique storylines and characters as well. Possibly even unique gameplay, although at that point we would pretty much be close to some sort of AGI anyway.
- babyshake 4y agoCan someone please do this for some Lucasarts classics?
- seba_dos1 4y agoThey already did for one :)
- jimmygrapes 4y agoYeah, a little peeved that they called Maniac Mansion a Sierra game
- deleted 4y ago[deleted]
- jaimex2 4y agoWas mucking around with Sd and one of my first thoughts was making a "Where in Stable Diffusion is Carmen Sandiego"
- nope96 4y agoHere's more, characters from old DOS games: https://old.reddit.com/r/StableDiffusion/comments/x2wwxx/using_dos_games_as_init_images/ https://old.reddit.com/r/StableDiffusion/comments/x2wwxx/usi... and https://old.reddit.com/r/StableDiffusion/comments/x5qrje/using_dos_games_as_init_images_part_2/ https://old.reddit.com/r/StableDiffusion/comments/x5qrje/usi... I love what the AI did with the hot tub girl from Leisure Suit Larry!
- skhr0680 4y agoI'm mostly impressed by the guy from Dune 2, he looks like a real person!
- jasfi 4y agoThis is cool, but img2img likely couldn't be easily used to make images in such games, because every scene would look very different. The problem is that you can't maintain the exact look between images. It could be used for artistic ideas and raw material though.
- notahacker 4y agoI'd be interested to know the parameters used, especially prompt_strength The correspondence to the original image is not especially high: the Leisure Suit Larry image, for example, enhances the original colours of the sea in a nicely realistic way, but all the foreground detail is essentially reinvented from scratch, including some very obvious omissions. In some of them the changes to perspective and more lifelike skull/canyons etc might improve on the original image, but it also flips even pretty basic stuff like which shoulder the woman's hand is placed on (and yes, once you look at that hand closely, the fingers SD has had to add in are all wrong...) Ideally for this sort of use case you'd want high fidelity to the geometry of the original image but less fidelity to the palette (use more than 256 colours and naturalistic or artistic textures rather than lines and pixel dithering), but I'm not sure SD can manage that at the moment