4 ms·

It’s amazing that someday we’ll be able to pass in low fidelity pixel art sprite sheets to an AI and get back high definition hand drawn 2D graphics for use in

by xwdv 4y ago

It’s amazing that someday we’ll be able to pass in low fidelity pixel art sprite sheets to an AI and get back high definition hand drawn 2D graphics for use in games.

smoldesu 4y ago
Square Enix: Is it possible to learn this power?
jdamon96 4y ago
you could probably build this w/ current img-gen model tech! totally agree, absolutely crazy.
modfreq 4y ago
Get out of my head! I literally just registered spritesheet.ai yesterday. and I've already had mild success training a model on spritesheet data.
- ranger47 4y ago
  I'm interested in following your project if you have a blog or anything.
  - modfreq 4y ago
    I only just recently started building things for fun again (Thanks AI) so I haven't had a blog in many years. But I'll be launching one on alexbrown.io sometime in the next few weeks to document my projects.
- kyleyeats 4y ago
  Someone put out a really compelling one a couple months ago: https://www.reddit.com/r/StableDiffusion/comments/yj1kbi/ive_trained_a_new_model_to_output_pixel_art/ https://www.reddit.com/r/StableDiffusion/comments/yj1kbi/ive...
  - modfreq 4y ago
    Nice. Thanks!
- throwaway675309 4y ago
  I've been sending emails to the creators of mid journey to scrape the entire archive over at spriters resource to create a custom model specifically to generate pixel sprite sheets. https://www.spriters-resource.com https://www.spriters-resource.com Fingers crossed.
qbasic_forever 4y ago
I don't see how animations would work with the current crop of image generation tools. If you feed in 5 frames of a character swinging a sword pixel art you'll get five wildly different renditions of the character, not one character with a smooth tweening of the sword swing.
- deleted 4y ago
  [deleted]
- birracerveza 4y ago
  That's why an artist is still needed to smooth it out and make it coherent, but at least 90% of the work is already done.
js8 4y ago
Actually, one day we will be able to do this not just with sprite sheets, but whole games.
Sophira 4y ago
"Hand drawn" is a huge misnomer there - it wouldn't be hand drawn at all, that's the point.

by xwdv 4y ago

It’s amazing that someday we’ll be able to pass in low fidelity pixel art sprite sheets to an AI and get back high definition hand drawn 2D graphics for use in games.

smoldesu 4y ago

Square Enix: Is it possible to learn this power?

jdamon96 4y ago

you could probably build this w/ current img-gen model tech! totally agree, absolutely crazy.

modfreq 4y ago

Get out of my head! I literally just registered spritesheet.ai yesterday. and I've already had mild success training a model on spritesheet data.

ranger47 4y ago
I'm interested in following your project if you have a blog or anything.
- modfreq 4y ago
  I only just recently started building things for fun again (Thanks AI) so I haven't had a blog in many years. But I'll be launching one on alexbrown.io sometime in the next few weeks to document my projects.
kyleyeats 4y ago
Someone put out a really compelling one a couple months ago: https://www.reddit.com/r/StableDiffusion/comments/yj1kbi/ive_trained_a_new_model_to_output_pixel_art/ https://www.reddit.com/r/StableDiffusion/comments/yj1kbi/ive...
- modfreq 4y ago
  Nice. Thanks!
throwaway675309 4y ago
I've been sending emails to the creators of mid journey to scrape the entire archive over at spriters resource to create a custom model specifically to generate pixel sprite sheets. https://www.spriters-resource.com https://www.spriters-resource.com Fingers crossed.

qbasic_forever 4y ago

I don't see how animations would work with the current crop of image generation tools. If you feed in 5 frames of a character swinging a sword pixel art you'll get five wildly different renditions of the character, not one character with a smooth tweening of the sword swing.

deleted 4y ago
[deleted]
birracerveza 4y ago
That's why an artist is still needed to smooth it out and make it coherent, but at least 90% of the work is already done.

js8 4y ago

Actually, one day we will be able to do this not just with sprite sheets, but whole games.

Sophira 4y ago

"Hand drawn" is a huge misnomer there - it wouldn't be hand drawn at all, that's the point.