5 ms·

Amazing work! Someone is probably already working on porting it to work as an extension on Stable Diffusion webui.

mrieck 3y ago
Yeah, haven't tested it but I assume this would work for realistic cartoon/cgi characters? Maybe the researchers didn't want to freak out anyone who does 2D animation? "Hey everyone, look at this toy we made that would never be used to animate anything but toy doodles. No one's 2D animation jobs are being replaced here - this project would never do that!"
- lancesells 3y ago
  No animator is looking at those examples and being worried. It's interesting for sure but I would put it on the most bottom tier of animation.
  - biggerChris 3y ago
    [dead]
  - dhosek 3y ago
    The bottom tier of animation is still pretty big. You apparently are too young to remember what a lot of animation was like in the 70s and 80s.
    - mensetmanusman 3y ago
      Is it like how typists were the bottom tier of office work?
    - ecshafer 3y ago
      Look at what AI generated images were like a year or two ago. They were mostly abstract, dream like images that were cool but not usable. They have improved 1000x in a year. Bottom tier animation from cartoon images now, could be seriously impressive in a few short years.
- thrashh 3y ago
  This doesn’t look like AI. This looks like an algorithm like how hash map is an algorithm. It’s also being presented at SIGGRAPH which further makes me think it’s just an algorithm to map motion capture data to a 2D image. We can already map motion capture data to a 3D model.
  - mrieck 3y ago
    Yeah I didn't read through it earlier. Seems like there are 3 parts from my understanding. You need some motion capture service like Rokoko/DeepMotion to create BVH files describing the movement from a video. The algorithm this guy created animates/renders by taking the BVH and an annotation file from the drawing. But the project did "train a drawn humanoid figure detector and pose estimator and provided scripts to automatically generate annotation files from the model predictions" so that part does have machine learning. I would love to use this for my old animation website https://www.superanimo.com/ https://www.superanimo.com/ But due to the AI boom I have tons of work to do on my other projects, so I can't sink time into modernizing my crappy animation site.

Yeah, haven't tested it but I assume this would work for realistic cartoon/cgi characters? Maybe the researchers didn't want to freak out anyone who does 2D animation? "Hey everyone, look at this toy we made that would never be used to animate anything but toy doodles. No one's 2D animation jobs are being replaced here - this project would never do that!"

lancesells 3y ago
No animator is looking at those examples and being worried. It's interesting for sure but I would put it on the most bottom tier of animation.
- biggerChris 3y ago
  [dead]
- dhosek 3y ago
  The bottom tier of animation is still pretty big. You apparently are too young to remember what a lot of animation was like in the 70s and 80s.
  - mensetmanusman 3y ago
    Is it like how typists were the bottom tier of office work?
  - ecshafer 3y ago
    Look at what AI generated images were like a year or two ago. They were mostly abstract, dream like images that were cool but not usable. They have improved 1000x in a year. Bottom tier animation from cartoon images now, could be seriously impressive in a few short years.
thrashh 3y ago
This doesn’t look like AI. This looks like an algorithm like how hash map is an algorithm. It’s also being presented at SIGGRAPH which further makes me think it’s just an algorithm to map motion capture data to a 2D image. We can already map motion capture data to a 3D model.
- mrieck 3y ago
  Yeah I didn't read through it earlier. Seems like there are 3 parts from my understanding. You need some motion capture service like Rokoko/DeepMotion to create BVH files describing the movement from a video. The algorithm this guy created animates/renders by taking the BVH and an annotation file from the drawing. But the project did "train a drawn humanoid figure detector and pose estimator and provided scripts to automatically generate annotation files from the model predictions" so that part does have machine learning. I would love to use this for my old animation website https://www.superanimo.com/ https://www.superanimo.com/ But due to the AI boom I have tons of work to do on my other projects, so I can't sink time into modernizing my crappy animation site.