10 ms·
Remaking old computer graphics with AI image generation
- xwdv 4y agoIt’s amazing that someday we’ll be able to pass in low fidelity pixel art sprite sheets to an AI and get back high definition hand drawn 2D graphics for use in games.
- smoldesu 4y agoSquare Enix: Is it possible to learn this power?
- jdamon96 4y agoyou could probably build this w/ current img-gen model tech! totally agree, absolutely crazy.
- modfreq 4y agoGet out of my head! I literally just registered spritesheet.ai yesterday. and I've already had mild success training a model on spritesheet data.
- ranger47 4y agoI'm interested in following your project if you have a blog or anything.
- modfreq 4y agoI only just recently started building things for fun again (Thanks AI) so I haven't had a blog in many years. But I'll be launching one on alexbrown.io sometime in the next few weeks to document my projects.
- kyleyeats 4y agoSomeone put out a really compelling one a couple months ago: https://www.reddit.com/r/StableDiffusion/comments/yj1kbi/ive_trained_a_new_model_to_output_pixel_art/ https://www.reddit.com/r/StableDiffusion/comments/yj1kbi/ive...
- modfreq 4y agoNice. Thanks!
- throwaway675309 4y agoI've been sending emails to the creators of mid journey to scrape the entire archive over at spriters resource to create a custom model specifically to generate pixel sprite sheets. https://www.spriters-resource.com https://www.spriters-resource.com Fingers crossed.
- qbasic_forever 4y agoI don't see how animations would work with the current crop of image generation tools. If you feed in 5 frames of a character swinging a sword pixel art you'll get five wildly different renditions of the character, not one character with a smooth tweening of the sword swing.
- deleted 4y ago[deleted]
- birracerveza 4y agoThat's why an artist is still needed to smooth it out and make it coherent, but at least 90% of the work is already done.
- js8 4y agoActually, one day we will be able to do this not just with sprite sheets, but whole games.
- Sophira 4y ago"Hand drawn" is a huge misnomer there - it wouldn't be hand drawn at all, that's the point.
- js8 4y agoI have a question. Stable diffusion is based on gradually processing noise into a coherent image, by training a denoiser. Would it be possible to feed low-fidelity image (such as pixel art, or pixelated image) directly into the denoiser step and get a higher-fidelity image that would match the original?
- mschulkind 4y agoYes, stable diffusion has an img2img mode that does essentially exactly that.
- sigmar 4y agoI think what you are describing is called super-resolution https://ai.googleblog.com/2021/07/high-fidelity-image-generation-using.html https://ai.googleblog.com/2021/07/high-fidelity-image-genera...
- charcircuit 4y agoIt's noise in a latest space which is different from noise in the image that the vector represents.
- newobj 4y agoNice, loses all its charm and turns off my imagination.
- deleted 4y ago[deleted]
- postalrat 4y agoYou wouldn't have those problems if you stuck to 320x240 pixels on your display.
- Teslazar 4y agoIs there a way to have current AI tools maintain consistency when generating multiple images of a specific creature or object? For example, if there are images of 'Dr. Venom' they need to look similar, or if there are images of the same space ship.
- djur 4y agoTextual inversion can kind of do this, but I haven't been impressed by examples I've seen. It seems more suited to "Shrek as a lawnmower" than "Shrek reading a book".
- lilgreenland 4y agomidJourney lets you upload a reference image. For a portrait of someone's face this produces consistently the same person.
- astrange 4y agoThe concept of “similar” is AI-complete (ie, only you knows what seems acceptably similar to you), so basically, no. You can force a model to generate nearly the same actual pixels with DreamBooth, which can be interesting for putting people’s faces in a picture, but otherwise I’d call it overfitting.
- enchiridion 4y agoIs AI-complete an actual complexity class? Genuinely curious, I’ve never heard of it.
- FartyMcFarter 4y agoI think it's just an informal term for things that seem to require human-level AI.
- enchiridion 4y agoAh, don’t care for it in that case. Seems like it’s cashing in on the formality associated with algorithms research.
- carrolldunham 4y agoThe title excited me - maybe someone succeeded making new art that looks like the old pre-renders, maybe a convincing imitation of the scanline render look. Instead it was a vapid article about tossing pixel art into img-2-img and getting some tenuously related junk.
- canadianfella 4y ago[dead]
- Jiro 4y agoHe didn't even do that. He used text descriptions; the original pixel art wasn't involved.
- layer8 4y agoI guess that explains why the results were only vaguely related to the original pictures.
- nineteen999 4y agoI think the new images look jarring next to the original 8-bit Konami style font at the bottom, the look clashes in my mind. I would have pixelated the generated images and dithered them down to a smaller palette to look more retro. Or kept the hi-res images but subtituted the fonts to something more detailed and modern. But that's just me.
- hnbad 4y agoIt reminds me of those HD texture packs for Minecraft in the early days that would attempt to map photorealistic textures onto a world almost entirely made of cubes. Yes it's more high-fidelity, but it adds nothing except emphasizing the low fidelity of everything else.
- nineteen999 4y ago
- NicoleJO 4y ago[flagged]
- pixl97 4y agoBecause a large portion of us on HN aren't big fans of IP laws that last seemly forever.
- deleted 4y ago[deleted]
- NicoleJO 4y agoThe demographic is criminal??
- pixl97 4y agoI don't reckon that you've studied the history of hackers much. If we go back to the 80s and people were making acoustic couplers and hooking them to their telephone would you be calling them out for breaking the telco rules, or would you be asking for a blueprint to make your own?
- o_____________o 4y agoWhere's that?
- astrange 4y agoSince it’s legal (via explicit non-commercial data mining exemptions in EU law), it literally isn’t stolen.
- deleted 4y ago[deleted]
- NicoleJO 4y agoIt's not legal to reproduce copyrighted content. Idgaf where you live.
- sublinear 4y agoYou'd have to scale the resolution on these waayyy down to not see the usual janky, smudgy, sometimes nightmare-inducing details. I seriously have never understood why what gets published in these blog posts isn't just lower res especially since this is precisely about old video game graphics.
- verdenti 4y ago[dead]
- kybernetyk 4y ago>the usual janky, smudgy, sometimes nightmare-inducing details I usually don't notice those. It's only when someone mentions it.
- deleted 4y ago[deleted]
- siraben 4y agoI was trying this recently with the Sierra Christmas Card from 1986![0] The images that I generated were[1], and I was trying to tweak the model parameters with different denoising and CFG scales. When you get the parameters just right you can preserve the composition of the input image very well while still adding a lot of detail. This isn't a completely automatic process though, with Stable Diffusion you have to provide the right prompt otherwise the generation process isn't guided correctly, so approach works better for aesthetics and style transfer than regular image super-resolution such as ESRGAN. [0] https://archive.org/details/sierra-christmas-card-1986 https://archive.org/details/sierra-christmas-card-1986 [1] https://i.imgur.com/WxD05gX.jpeg https://i.imgur.com/WxD05gX.jpeg
- Agentlien 4y agoIf you're using stable diffusion 2.0 or later you can use its depth-to-image mode[0] to create variations of an image which respect its composition without having to keep your parameters within a narrow range. [0] https://github.com/Stability-AI/stablediffusion#image-modification-with-stable-diffusion https://github.com/Stability-AI/stablediffusion#image-modifi...
- siraben 4y agoI still struggle with SD 2.0 prompting because many of the tricks (greg, artstation) don't work anymore, have people had success with it or do I have to use custom models?
- speedgoose 4y agoYou need other tricks and put a bit more thoughts in the negative prompt. The quality is then higher but you really need a good prompt. It’s a bit frustrating compared to midjourney or dall.e. You should take a look at embeddings too. They are tiny files, no more than 128kB, that have a huge influence on the final output. You put the files in the embeddings folder and use the filename in your prompt. Ideally the filename is a unique word so it doesn’t interfere with the normal prompt logic. You can find the best embeddings in the stable diffusion discord.
- vyrotek 4y agoThis would be super fun to use with "Return to Zork" clips.
- shdon 4y agoIs it just me, or was anybody else reminded of the Carmageddon cover art after seeing the image they ended up using for Dr. Venom?
- LudwigNagasena 4y agoThat’s just yet another exercise in prompt engineering. I expected something more interesting.
- camtarn 4y agoHonestly, really disappointing, especially since the author forces you to watch the video to see the final image - which looks nothing like the shoulder-spiked, triple-forehead-eye'd villain of the game. Spoiler, the generated image is just a threatening looking green dude with two different coloured eyes. It's a decent writeup on the process of trying to generate specific images using text prompts, I guess, with the conclusion that it's really hard, and in some cases basically impossible (hence the lack of the three forehead eyes).
- deleted 4y ago[deleted]
- spaceman_2020 4y agoYeah, I don’t think this tech is ready for production use at all right now. Great tech demo, not actually useful currently. In contrast, I’ve been using chatGPT multiple times daily
- ggambetta 4y agoAt last we have the tech to do a cinematic, photorealistic version of Zero Wing! For great justice!!!
- deleted 4y ago[deleted]
- hnbad 4y agoThis is a great example of AI image generation being unable to generate "art" and instead just replicating a naive approximation of what it was trained on. There's no coherence or consistency between the images and while they all look "shiny", they also look incredibly dull and generic. It's a cool exercise but using this for a real-world project would eliminate any attempt at producing an artistic "voice". AI image generation excels only at generating stock art and placeholder content.
- washadjeffmad 4y agoThat's more an issue with prompts and training. For as functional is it is, the established models are all very preliminary, and we're in a Cambrian explosion of sorts wrt tooling. Also, one model doesn't speak for them all. I have the problem that my results are often too consistent with certain models, largely because of prompt complexity, lack of wildcarding, etc.
- NicoleJO 4y agoWhat are you going to do about all the copyrighted material?