4 ms·

Like the rest of Facebook's AI research... I find this underwhelming. Not even good enough to trigger uncanny valley issues.

dtauzell 3y ago
Are there some similar models that are currently better?
- pseudosavant 3y ago
  I don't know, but I can't imagine having this as a feature in any app (Zoom, etc) and leaving it on. That is how most of FB's AI research seems. Not good enough to make into a real product or feature.
  - TaylorAlexander 3y ago
    The nature of this type of research is that there are long term goals which are currently unachievable with no clear concept for how to approach them, so researchers need to start putting small pieces together and working out how to make it all work smoothly as a single concept. It looks like someone had a neural network for mouth movement. Someone had one for body movement, etc. Composing multiple systems in to one teaches us how we can approach more complex problems and how to better tie things together than just inserting the output of one in to the input of another. Long term this type of work helps solve big problems even if the intermediate steps don’t produce exciting results. As an example, early image generators were pretty uninteresting but today they are widely utilized and generally considered impressive. The thing that researchers in the field know that the public doesn’t is that there’s 100 boring steps before the exciting release, and some of the boring steps are very exciting on a technical level. Those intermediate achievements represent 99% of what machine learning research actually is and others in the field appreciate those works.
echelon 3y ago
Also CC-NC. They want free feedback, but won't let you use it to make anything yourself.
- pk-protect-ai 3y ago
  Let's suppose the code will be re-implemented within huggingface transformers library and then you pour bunch of money into new dataset and the training and license it under MIT or create a separate product and sell the result of its work. Will this violate the CC-NC?
  - nmfisher 3y ago
    If you've reimplemented the code and recreated your own dataset, I don't see how that would violate the licence.
    - pk-protect-ai 3y ago
      That was my point. What you need is money and time. If you invest into independent implementation, you will have your model and the product for any applicable purposes at required quality.
smusamashah 3y ago
This is amazing if used in games. Game designer can easily create realistic body movement just using audio.

dtauzell 3y ago

Are there some similar models that are currently better?

pseudosavant 3y ago
I don't know, but I can't imagine having this as a feature in any app (Zoom, etc) and leaving it on. That is how most of FB's AI research seems. Not good enough to make into a real product or feature.
- TaylorAlexander 3y ago
  The nature of this type of research is that there are long term goals which are currently unachievable with no clear concept for how to approach them, so researchers need to start putting small pieces together and working out how to make it all work smoothly as a single concept. It looks like someone had a neural network for mouth movement. Someone had one for body movement, etc. Composing multiple systems in to one teaches us how we can approach more complex problems and how to better tie things together than just inserting the output of one in to the input of another. Long term this type of work helps solve big problems even if the intermediate steps don’t produce exciting results. As an example, early image generators were pretty uninteresting but today they are widely utilized and generally considered impressive. The thing that researchers in the field know that the public doesn’t is that there’s 100 boring steps before the exciting release, and some of the boring steps are very exciting on a technical level. Those intermediate achievements represent 99% of what machine learning research actually is and others in the field appreciate those works.

echelon 3y ago

Also CC-NC. They want free feedback, but won't let you use it to make anything yourself.

pk-protect-ai 3y ago
Let's suppose the code will be re-implemented within huggingface transformers library and then you pour bunch of money into new dataset and the training and license it under MIT or create a separate product and sell the result of its work. Will this violate the CC-NC?
- nmfisher 3y ago
  If you've reimplemented the code and recreated your own dataset, I don't see how that would violate the licence.
  - pk-protect-ai 3y ago
    That was my point. What you need is money and time. If you invest into independent implementation, you will have your model and the product for any applicable purposes at required quality.

smusamashah 3y ago

This is amazing if used in games. Game designer can easily create realistic body movement just using audio.