6 ms·

Data-Driven Enhancement of Facial Attractiveness

103 points by sheffield 15y ago

losethos 15y ago
When talking of the time to write a Unix script, you have to factor-in the time to rewad the man page.
rakkhi 15y ago
What do you guys think about a smartphone app that could be panned around to capture a 3D image then used the golden mask to calculate an objective attractiveness score? Would be some fun engineering and probably pretty popular.
- gabaix 15y ago
  I have seen already on the Iphone. Can't remember what the name is.
  - rakkhi 15y ago
    Probably talking about this: http://appshopper.com/utilities/are-you-hot http://appshopper.com/utilities/are-you-hot It is just a random number generator though. Idea was that you could get an objective "hotness" or attractiveness rating based on how well your features fit the golden ratio / golden mask. It would also give users preferences when they first use the app (eg against 10-20 faces, which you can have precalculated all the points accurately), you can map each face against their preferred faces, giving the personalised rating system. Use case at a pub/bar quick scan of the iphone would give a objective rating and your rating. V2. could add location and start building real time tracking of where the hot women / men or those matching closer to your rating were going tonight :)
- bad_user 15y ago
  then used the golden mask to calculate an objective attractiveness score Except that you can't calculate an objective attractiveness score, even if there is statistical consensus among raters. Might as well just throw some random numbers on the screen, it wouldn't matter much anyway since your app will be less effective and gather less interest than HotOrNot.com did 11 years ago. A much better project would be a piece of software that automatically enhances the aesthetic appeal of people in photos. Imagine looking great in any profile picture you upload on Facebook (or whatever), without you or your friends noticing the change (blaming it on distortions from image resizing).
  - rakkhi 15y ago
    Interesting idea. Seems to be what the OP has researched
- rouzbeh_jolfa 15y ago
  It would be a cool app, and allot of new techniques may be invented or discovered while developing it. But one should ask what are the attractiveness criteria? what do you mean by "Data-driven". The data comes from other users? I mean aesthetics norms comes from society or the user, or both?! Very subjective! if we build tools to enforce aesthetics norms on users from the "common sense" - (things that never made sense too me), we are basically killing all the peculiar beauties in the world, say, a cute pimple next to the lip.
  - rakkhi 15y ago
    Data driven using research like this: http://www.mendeley.com/research/female-preference-for-male-faces-changes-cyclically-further-evidence/ http://www.mendeley.com/research/female-preference-for-male-... http://journal.nida.ac.th/journal/attachments/8_Sunthorn%20Kanghae.pdf http://journal.nida.ac.th/journal/attachments/8_Sunthorn%20K... http://psycnet.apa.org/journals/com/108/3/233/ http://psycnet.apa.org/journals/com/108/3/233/ Also would provide an option for you to rate 10-20 and give a personal rating.
albertsun 15y ago
It appears to just make each face smile more.
- wccrawford 15y ago
  Actually, if you look closer, it alters just about everything... Most noticeable is the size of the forehead, nose, chin and jaw. I don't see it there, but also correcting asymmetry helps as well.
jared314 15y ago
Why do they never release the applications for these things? Copyright?
- wccrawford 15y ago
  I always assumed they planned to create a commercial product. And maybe they do and we never hear of it.
  - khafra 15y ago
    I have a feeling that's very common. I recall a big to-do about Cortexica and their brain-inspired computer vision algorithm. They built it into an iPhone wine label recognition app, which currently has two ratings; both one-star.
- martincmartin 15y ago
  Generally, the code is very hacky, and (for example) the user may need to do a lot of steps to run it, many counter intuitive. In the Mythical Man-Month, Fred Brooks says that to go from a prototype that does everything you want, to one with nice packaging, takes 3x the effort. I'm not sure about the 3x number, but it does take a lot of effort.
- tsumnia 15y ago
  Most might not have the licensing issues. I'm not sure on the copyrights for things like Viola-Jones or Active Shape Modeling. I know Cootes has refused to release the source for his modeling software in case their financial incentive. The software is out there, I'll link some if you want. What you are really looking for is the training data used to create the faces though. That is where the money is.
tsumnia 15y ago
The PDF branches off of Active Shape Modeling (by Tim Cootes, https://secure.wikimedia.org/wikipedia/en/wiki/Active_shape_model https://secure.wikimedia.org/wikipedia/en/wiki/Active_shape_...) with a style I'm not entirely familiar with, however basing off my background I think I can expain a little of what is going one. Active Appearance Models are a extension of Active Shape Modeling, effectively taking a set of landmark points on a shape (in this case a face), and averaging them out to the 'average shape' of the face. AAMs take it to the next level by taking this average face and warping the original landmarked face to the average shape. From here it takes the average of the textures of the face, producing eigenvectors. These vectors would be used as a unique identifier if the program was running some form of face recognition. In lieu of face recognition something you can use the averaged AAM face for it recreating a face BASED off the average (say for this paper's example: beauty). By generating an averaged AAM model off only those subjects that scored an 8 (out of 10) or above, you create the 'average attractive face'. Now, if you take John Doe's face with a score 5, and generate the eigenvectors that would represent his face based on the 'Good-Looking People Only Scale', it would create a better looking version of him. Another application of this technique is digital face aging (example here: http://www.intechopen.com/source/pdfs/14645/InTech-Implications_of_adult_facial_aging_on_biometrics.pdf http://www.intechopen.com/source/pdfs/14645/InTech-Implicati...) in which instead of 'morphing' the subject's face to look more attractive, you morph the subject's to look 'older' based on statistical averages based on age range, gender, and ethnicity.
hugh3 15y ago
Man, I'd hate to be one of the models for one of these pictures. "Ohhhh yeah," say thousands of internet users. "That computer-generated version really is a lot better-looking than the real one due to those horrible flaws on that person's face". No thanks, I'd rather not see the difference between my face and a better-looking version of my face, it'd just make me feel bad. On a broader point though, the human taste for "average-looking" faces is an interesting one. Aside from anything else it's an interesting Nash equilibrium -- I want to find a mate with an average-looking face so that we can produce children with average-looking faces who will be the most desirable breeding partners in the next generation. What I really wonder is whether "average-looking" is hard-wired in, or whether we're programmed to spend our childhood scanning all the faces around us and mentally averaging them out to determine what a human face should look like. I suspect the latter -- it's a much more stable strategy over evolutionary timescales, and also explains things like why people often find people of their own race more attractive, and why mixed-race people are often unusually attractive.
- pegasus 15y ago
  How does the second hypothesis explains both of those tendencies at the same time? It would rather seem to predict that people of mixed race would be found less attractive then those of the same race as the subject and more attractive then those of the other race. I.e. an averaging out of attractiveness rather then an increase of it.
  - hugh3 15y ago
    Oh, it depends where you're brought up. What you really find attractive is a mix of all the races in the community where you were brought up. If everyone you meet in childhood is of the same race then you'll probably find that race attractive, but if you (say) spend half your time hanging out with whites and half your time hanging out with Asians...
    - fourk 15y ago
      I don't believe that this is necessarily true. Personally, I grew up in a >98% white town, and yet I find myself attracted to attracted to Asians. Relevant: http://blog.okcupid.com/index.php/your-race-affects-whether-people-write-you-back/ http://blog.okcupid.com/index.php/your-race-affects-whether-...
trebor 15y ago
Most common attractive feature: a smile! Even if not outright happy, just looking relaxed or cheerful helps.
- r00fus 15y ago
  This is also what I noticed immediately. A smile goes a long way to determining "beauty". Perhaps this is because a smile indicates a positive/friendly demeanor? I always had the best impression of women with whom I worked/studied with were the ones who were warm to me. Perhaps beauty does come from the inside?
  - trebor 15y ago
    I think that it's more important to look friendly, or approachable, to be attractive to someone. In my experience I've found that a smile is better than a scowl, and definitely better than a neutral expression. True beauty comes from inside. My grandparents weren't terribly attractive... but I'll never forget my grandfather's smile. When he smiled it lit his face in such a powerful way I can see him even now (he's been dead almost 9 years!). And I don't think that women looking "flirty" is attractive. Looks more predatory to me.
    - bad_user 15y ago
      I don't think that women looking "flirty" is attractive. But they are more attractive - for the same reason that women wearing short skirts are more attractive and it may not be for the same reason you think it is. The reason has to do with accessibility: women, unlike men, are very picky when it comes to dating. We (men) know this and when a woman doesn't look like she's looking for men, we often choke or don't bother pursuing a date. A flirty attitude is the strongest indication that a woman is interested. Looks more predatory to me Some people, men or women alike, often end up with dumb looks in photos :: that's what happens when wanting to simulate sensuality when you're not in the mood, not to mention some people are just not photogenic and really need the help of an expert for such photos. I am talking about genuine sexy looks above, not "let me eat your brain" looks :)
- 15y ago
peteretep 15y ago
As far as I can see from the pictures, people like women more when they smile, and men more when they lose weight.
- eru 15y ago
  When they lose fat.
aj700 15y ago
Is the software pictured at the bottom of the page avail to download?
zbowling 15y ago
Forget fatbooth. Make this an iPhone app and you would be a millionaire!
impendia 15y ago
There are 100,000 people on online dating sites that would pay $20 each for this.
- tsumnia 15y ago
  The issue with this comes into play of manipulating their face from different angles, which is still an issue in the biometric world. OKCupid's posted statistics on the 'more attractive' profiles, and not all the profiles use the stare directly into the camera shot. Needless to say, yes, some of them do need this.
- dstein 15y ago
  I think people would also pay to have this algorithm programmatically identify people that are attractive and filter everyone else out.
- Lost_BiomedE 15y ago
  There was a reconstructive surgeon that did a lot research into beauty, because he had to remake faces given partial information. He found golden ratios for all the major features of the face. He constructed a transparent mask with guidelines and did wonders for his patients. This was the best application I have heard for similar research. Not so much for the money aspect but for the good it did.
afterburner 15y ago
For the male example at the top, the shape of the face is so changed it doesn't look like the same person.
ignifero 15y ago
You know what i think, the filters put a smile on these photos rather than anything else.

103 points by sheffield 15y ago

When talking of the time to write a Unix script, you have to factor-in the time to rewad the man page.

What do you guys think about a smartphone app that could be panned around to capture a 3D image then used the golden mask to calculate an objective attractiveness score? Would be some fun engineering and probably pretty popular.

gabaix 15y ago
I have seen already on the Iphone. Can't remember what the name is.
- rakkhi 15y ago
  Probably talking about this: http://appshopper.com/utilities/are-you-hot http://appshopper.com/utilities/are-you-hot It is just a random number generator though. Idea was that you could get an objective "hotness" or attractiveness rating based on how well your features fit the golden ratio / golden mask. It would also give users preferences when they first use the app (eg against 10-20 faces, which you can have precalculated all the points accurately), you can map each face against their preferred faces, giving the personalised rating system. Use case at a pub/bar quick scan of the iphone would give a objective rating and your rating. V2. could add location and start building real time tracking of where the hot women / men or those matching closer to your rating were going tonight :)
bad_user 15y ago
then used the golden mask to calculate an objective attractiveness score Except that you can't calculate an objective attractiveness score, even if there is statistical consensus among raters. Might as well just throw some random numbers on the screen, it wouldn't matter much anyway since your app will be less effective and gather less interest than HotOrNot.com did 11 years ago. A much better project would be a piece of software that automatically enhances the aesthetic appeal of people in photos. Imagine looking great in any profile picture you upload on Facebook (or whatever), without you or your friends noticing the change (blaming it on distortions from image resizing).
- rakkhi 15y ago
  Interesting idea. Seems to be what the OP has researched
rouzbeh_jolfa 15y ago
It would be a cool app, and allot of new techniques may be invented or discovered while developing it. But one should ask what are the attractiveness criteria? what do you mean by "Data-driven". The data comes from other users? I mean aesthetics norms comes from society or the user, or both?! Very subjective! if we build tools to enforce aesthetics norms on users from the "common sense" - (things that never made sense too me), we are basically killing all the peculiar beauties in the world, say, a cute pimple next to the lip.
- rakkhi 15y ago
  Data driven using research like this: http://www.mendeley.com/research/female-preference-for-male-faces-changes-cyclically-further-evidence/ http://www.mendeley.com/research/female-preference-for-male-... http://journal.nida.ac.th/journal/attachments/8_Sunthorn%20Kanghae.pdf http://journal.nida.ac.th/journal/attachments/8_Sunthorn%20K... http://psycnet.apa.org/journals/com/108/3/233/ http://psycnet.apa.org/journals/com/108/3/233/ Also would provide an option for you to rate 10-20 and give a personal rating.

albertsun 15y ago

It appears to just make each face smile more.

wccrawford 15y ago
Actually, if you look closer, it alters just about everything... Most noticeable is the size of the forehead, nose, chin and jaw. I don't see it there, but also correcting asymmetry helps as well.

jared314 15y ago

Why do they never release the applications for these things? Copyright?

wccrawford 15y ago
I always assumed they planned to create a commercial product. And maybe they do and we never hear of it.
- khafra 15y ago
  I have a feeling that's very common. I recall a big to-do about Cortexica and their brain-inspired computer vision algorithm. They built it into an iPhone wine label recognition app, which currently has two ratings; both one-star.
martincmartin 15y ago
Generally, the code is very hacky, and (for example) the user may need to do a lot of steps to run it, many counter intuitive. In the Mythical Man-Month, Fred Brooks says that to go from a prototype that does everything you want, to one with nice packaging, takes 3x the effort. I'm not sure about the 3x number, but it does take a lot of effort.
tsumnia 15y ago
Most might not have the licensing issues. I'm not sure on the copyrights for things like Viola-Jones or Active Shape Modeling. I know Cootes has refused to release the source for his modeling software in case their financial incentive. The software is out there, I'll link some if you want. What you are really looking for is the training data used to create the faces though. That is where the money is.

tsumnia 15y ago

The PDF branches off of Active Shape Modeling (by Tim Cootes, https://secure.wikimedia.org/wikipedia/en/wiki/Active_shape_model https://secure.wikimedia.org/wikipedia/en/wiki/Active_shape_...) with a style I'm not entirely familiar with, however basing off my background I think I can expain a little of what is going one. Active Appearance Models are a extension of Active Shape Modeling, effectively taking a set of landmark points on a shape (in this case a face), and averaging them out to the 'average shape' of the face. AAMs take it to the next level by taking this average face and warping the original landmarked face to the average shape. From here it takes the average of the textures of the face, producing eigenvectors. These vectors would be used as a unique identifier if the program was running some form of face recognition. In lieu of face recognition something you can use the averaged AAM face for it recreating a face BASED off the average (say for this paper's example: beauty). By generating an averaged AAM model off only those subjects that scored an 8 (out of 10) or above, you create the 'average attractive face'. Now, if you take John Doe's face with a score 5, and generate the eigenvectors that would represent his face based on the 'Good-Looking People Only Scale', it would create a better looking version of him. Another application of this technique is digital face aging (example here: http://www.intechopen.com/source/pdfs/14645/InTech-Implications_of_adult_facial_aging_on_biometrics.pdf http://www.intechopen.com/source/pdfs/14645/InTech-Implicati...) in which instead of 'morphing' the subject's face to look more attractive, you morph the subject's to look 'older' based on statistical averages based on age range, gender, and ethnicity.

hugh3 15y ago

Man, I'd hate to be one of the models for one of these pictures. "Ohhhh yeah," say thousands of internet users. "That computer-generated version really is a lot better-looking than the real one due to those horrible flaws on that person's face". No thanks, I'd rather not see the difference between my face and a better-looking version of my face, it'd just make me feel bad. On a broader point though, the human taste for "average-looking" faces is an interesting one. Aside from anything else it's an interesting Nash equilibrium -- I want to find a mate with an average-looking face so that we can produce children with average-looking faces who will be the most desirable breeding partners in the next generation. What I really wonder is whether "average-looking" is hard-wired in, or whether we're programmed to spend our childhood scanning all the faces around us and mentally averaging them out to determine what a human face should look like. I suspect the latter -- it's a much more stable strategy over evolutionary timescales, and also explains things like why people often find people of their own race more attractive, and why mixed-race people are often unusually attractive.

pegasus 15y ago
How does the second hypothesis explains both of those tendencies at the same time? It would rather seem to predict that people of mixed race would be found less attractive then those of the same race as the subject and more attractive then those of the other race. I.e. an averaging out of attractiveness rather then an increase of it.
- hugh3 15y ago
  Oh, it depends where you're brought up. What you really find attractive is a mix of all the races in the community where you were brought up. If everyone you meet in childhood is of the same race then you'll probably find that race attractive, but if you (say) spend half your time hanging out with whites and half your time hanging out with Asians...
  - fourk 15y ago
    I don't believe that this is necessarily true. Personally, I grew up in a >98% white town, and yet I find myself attracted to attracted to Asians. Relevant: http://blog.okcupid.com/index.php/your-race-affects-whether-people-write-you-back/ http://blog.okcupid.com/index.php/your-race-affects-whether-...

trebor 15y ago

Most common attractive feature: a smile! Even if not outright happy, just looking relaxed or cheerful helps.

r00fus 15y ago
This is also what I noticed immediately. A smile goes a long way to determining "beauty". Perhaps this is because a smile indicates a positive/friendly demeanor? I always had the best impression of women with whom I worked/studied with were the ones who were warm to me. Perhaps beauty does come from the inside?
- trebor 15y ago
  I think that it's more important to look friendly, or approachable, to be attractive to someone. In my experience I've found that a smile is better than a scowl, and definitely better than a neutral expression. True beauty comes from inside. My grandparents weren't terribly attractive... but I'll never forget my grandfather's smile. When he smiled it lit his face in such a powerful way I can see him even now (he's been dead almost 9 years!). And I don't think that women looking "flirty" is attractive. Looks more predatory to me.
  - bad_user 15y ago
    I don't think that women looking "flirty" is attractive. But they are more attractive - for the same reason that women wearing short skirts are more attractive and it may not be for the same reason you think it is. The reason has to do with accessibility: women, unlike men, are very picky when it comes to dating. We (men) know this and when a woman doesn't look like she's looking for men, we often choke or don't bother pursuing a date. A flirty attitude is the strongest indication that a woman is interested. Looks more predatory to me Some people, men or women alike, often end up with dumb looks in photos :: that's what happens when wanting to simulate sensuality when you're not in the mood, not to mention some people are just not photogenic and really need the help of an expert for such photos. I am talking about genuine sexy looks above, not "let me eat your brain" looks :)
15y ago

peteretep 15y ago

As far as I can see from the pictures, people like women more when they smile, and men more when they lose weight.

eru 15y ago
When they lose fat.

aj700 15y ago

Is the software pictured at the bottom of the page avail to download?

zbowling 15y ago

Forget fatbooth. Make this an iPhone app and you would be a millionaire!

impendia 15y ago

There are 100,000 people on online dating sites that would pay $20 each for this.

tsumnia 15y ago
The issue with this comes into play of manipulating their face from different angles, which is still an issue in the biometric world. OKCupid's posted statistics on the 'more attractive' profiles, and not all the profiles use the stare directly into the camera shot. Needless to say, yes, some of them do need this.
dstein 15y ago
I think people would also pay to have this algorithm programmatically identify people that are attractive and filter everyone else out.
Lost_BiomedE 15y ago
There was a reconstructive surgeon that did a lot research into beauty, because he had to remake faces given partial information. He found golden ratios for all the major features of the face. He constructed a transparent mask with guidelines and did wonders for his patients. This was the best application I have heard for similar research. Not so much for the money aspect but for the good it did.

afterburner 15y ago

For the male example at the top, the shape of the face is so changed it doesn't look like the same person.

ignifero 15y ago

You know what i think, the filters put a smile on these photos rather than anything else.