4 ms·
First, you need reliable training data to begin with. This can't be supplied by third-party labeling of faces, so it would need to be done with a dataset of sel
by crazygringo 6y ago
First, you need reliable training data to begin with. This can't be supplied by third-party labeling of faces, so it would need to be done with a dataset of self-reported emotions, but self-reported emotions also have tons of pitfalls well documented in the literature.
But second, the correlations of individual facial muscle contractions with emotions has been extensively studied and it's far noisier, inconsistent, or completely devoid of a signal than many people assume. In academic terms there's no such thing as a reliable emotional "signature" to be gleaned from facial muscle activation.
So the point is, it appears that the raw data simply isn't there for the AI to detect patterns that humans can't. Detecting emotions requires far more data points outside of facial muscle activation -- such as the ones I listed.
- visarga 6y agoUnsupervised learning is really good today, about 1-2% under supervised learning. You can also cross correlate text, audio and video. If there's signal in the data, then a model can learn it, and you don't need so many labels.
- wizzwizz4 6y agoThe signal is facial expressions. You're missing the “map facial expressions to emotions” step.
- unishark 6y agoYour argument is basically that since something is hard it is impossible?
- crazygringo 6y agoNo, my argument is that if something is impossible it's impossible. I said "the raw data isn't there", not that "the raw data is hard to interpret".
- neolog 6y ago> self-reported emotions also have tons of pitfalls well documented in the literature That's interesting. Where can I read about these issues?
- nl 6y ago> This can't be supplied by third-party labeling of faces Yes it can. You get enough labelling and it overcomes the unreliability of detection by any single human. Get 70 people to label the same face. A random distribution over the 7 Ekman emotions[1] will give 10 each, and any non-random variation from that is a signal. Do that over enough faces and you'll get something to train on. (Also, no reason why it needs to be face pictures. It could be 2 second video snippets for example). [1] https://www.paulekman.com/blog/darwins-claim-universals-facial-expression-challenged/ https://www.paulekman.com/blog/darwins-claim-universals-faci...
- crazygringo 6y agoNo, because the fundamental problem isn't the unreliability of detection by any single human. The fundamental problem is that multiple emotions can result in the same facial expression, and the same emotion can result in multiple facial expressions. It doesn't matter how many people label a face. It won't get over the fundamental issue that there is no 1-1 mapping between emotions and facial expressions.
- PeterisP 6y agoA 1-1 mapping isn't required, IMHO everybody involved would consider a probability distribution as a reasonable expected output, and as long as that probability distribution is reasonably close to reality and is substantially different from the prior, output like that is useful signal and would count as the system working. The same applies for labeling, if a particular facial expression can occur in an indistinguishable manner because of three different causes, that's okay; there's nothing wrong with a gold standard label in training data marked as "we've observed that 50% people had this expression because they were angry and 30% because they were in pain, but no happy or sleepy people had an expression like that". Furthermore, for the purpose listed in the article, you don't need to determine an absolute value of some emotional state, but you need to detect large shifts in it (i.e. you get an baseline that implicitly adjusts for part of individual and cultural differences) - i.e. whether the audience (in aggregate!) now looks significantly more frustrated than the same people looked 30 minutes ago.
- 6y ago