3 ms·

Has anyone made a pixel art generator, that can create the animation sprites ?

gxqoz 4y ago
You can use DALL-E and other models to make pixel art ("as pixel art"), although it can both be overkill and hard to get consistent results that you'd put into animation. I'm guessing that starting from more of a video model and then converting to pixel art could be better. Although it's also non-trivial to turn "realistic" video into convincing animation.
- 999900000999 4y ago
  I pay good money for a specialized machine learning algorithm that can take a pixel art character, and then generate all the animated sprites for it. I actually tried to get Dalle to do this, And it made like three good sprites in the rest were just broken. But it was so strange, because you could see it was still organized as a sprite sheet, it's just the sprites were useless. I think the practical applications of this technology will be hyper specialized models for specific purposes.
0xdead1eaf 4y ago
Check out NUWA-Infinity[0][1], submitted to arxiv jul 20, 2022. It captures artistic style very well (though can't speak to the quality of the pixel art it would generate) and can do image to video. [0] https://nuwa-infinity.microsoft.com/#/ https://nuwa-infinity.microsoft.com/#/ [1] https://arxiv.org/abs/2207.09814 https://arxiv.org/abs/2207.09814
tckerr 4y ago
This is exactly the type of application I am interested in as well. As a hobby game dev with only mediocre pixel art skills, having a generator to finish the busy work would be an absolute lifesaver. I'm also interested in using it for fleshing out artistic vision through generating variations of an initial concept. Hopefully we aren't more than a few years away from something practical like this.
_w1kke_ 4y ago
@KaliYuga did - she got hired by StabilityAI just a few days ago. Here is a link to the Pixel Art Diffusion notebook: https://colab.research.google.com/github/KaliYuga-ai/Pixel-Art-Diffusion/blob/main/Pixel_Art_Diffusion_v2_01.ipynb https://colab.research.google.com/github/KaliYuga-ai/Pixel-A...
chucky123 4y ago
That's a really good idea.
panabee 4y ago
hi there. we're working on this, been working on a model for months now. hope to release something soon. how best to get in touch with you?

You can use DALL-E and other models to make pixel art ("as pixel art"), although it can both be overkill and hard to get consistent results that you'd put into animation. I'm guessing that starting from more of a video model and then converting to pixel art could be better. Although it's also non-trivial to turn "realistic" video into convincing animation.

999900000999 4y ago
I pay good money for a specialized machine learning algorithm that can take a pixel art character, and then generate all the animated sprites for it. I actually tried to get Dalle to do this, And it made like three good sprites in the rest were just broken. But it was so strange, because you could see it was still organized as a sprite sheet, it's just the sprites were useless. I think the practical applications of this technology will be hyper specialized models for specific purposes.

0xdead1eaf 4y ago

Check out NUWA-Infinity[0][1], submitted to arxiv jul 20, 2022. It captures artistic style very well (though can't speak to the quality of the pixel art it would generate) and can do image to video. [0] https://nuwa-infinity.microsoft.com/#/ https://nuwa-infinity.microsoft.com/#/ [1] https://arxiv.org/abs/2207.09814 https://arxiv.org/abs/2207.09814

tckerr 4y ago

This is exactly the type of application I am interested in as well. As a hobby game dev with only mediocre pixel art skills, having a generator to finish the busy work would be an absolute lifesaver. I'm also interested in using it for fleshing out artistic vision through generating variations of an initial concept. Hopefully we aren't more than a few years away from something practical like this.

_w1kke_ 4y ago

@KaliYuga did - she got hired by StabilityAI just a few days ago. Here is a link to the Pixel Art Diffusion notebook: https://colab.research.google.com/github/KaliYuga-ai/Pixel-Art-Diffusion/blob/main/Pixel_Art_Diffusion_v2_01.ipynb https://colab.research.google.com/github/KaliYuga-ai/Pixel-A...

chucky123 4y ago

That's a really good idea.

panabee 4y ago

hi there. we're working on this, been working on a model for months now. hope to release something soon. how best to get in touch with you?