4 ms·
Actually, our work not only targets lip movements, it can also produce more realistic head movements and facial muscle movements. ps: It also achieved a good sy
by HuiLi1998 2y ago
Actually, our work not only targets lip movements, it can also produce more realistic head movements and facial muscle movements. ps: It also achieved a good syncnnet score on 200 randomly collected wild image-audio pair. And it is open sourced.:)
- BoredPositron 2y agoI get exactly what you are doing but I don't understand what would be novel about it? It really looks just like a simple SD/wav2vec/insightface/animatediff pipeline, everyone can plug together in comfy or with diffusers. The muscle claim is also a bit dubious... PS: With insightface models in your reqs the oss aspect is also pretty much void for any use other than research and your readme should reflect that.