7 ms·

FaceFusion: Next generation face swapper and enhancer

73 points by pocketarc 3y ago

TedDoesntTalk 3y ago
> It has a built-in check which prevents the program from working on inappropriate media including but not limited to nudity, graphic content, sensitive material such as war footage etc. This is noble, but git… open-source… forks…
- azeemba 3y ago
  Since face swapping tools crop.up frequently, what is their pitch? What are the non-abusive use cases for face swapping?
  - Filligree 3y ago
    Putting yourself or a friend in a movie scene, for example.
    - fullspectrumdev 3y ago
      Lol, literally what I use it for half the time for meme reasons.
  - carstenhag 3y ago
    Entertainment (memes). Trying out a new hairstyle matching your face.
    - falcor84 3y ago
      The hairstyle thing sounds like a killer feature, but I think that it would be relatively quickly overtaken by whoever makes it easier to create 3d models of yourself at metahuman-like level.
  - woleium 3y ago
    Digital marketing agencies can make website team pages look much more professional without having to go to the expense of a photo shoot
    - CSSer 3y ago
      Perhaps this is a bit cheeky, but I think it'd be pretty hilarious if a company, intentionally or otherwise, used this to generate a bunch of uniform headshots that made all of the employees at a company look like they're in way better shape than they actually are.
    - flangola7 3y ago
      So the model and photographer lose their job but the company bottom line is unchanged.
  - Tenoke 3y ago
    I use Roop (which this is a successor of) to make stablediffusion pictures of myself (e.g. for my slack avatar).
  - fullspectrumdev 3y ago
    Amusement. Putting your mates in a film scene. Making silly memes. Etc. Not everything needs a “serious” usecase.
    - flangola7 3y ago
      It does where the negative use cases are very harmful. I can think of many fun projects I could pursue in my chemistry lab if only the precursors and equipment for mass producing nerve agents and high explosives were not tightly regulated.
- throwitaway156 3y ago
  At least that check is not hosted elsewhere and the author is clear from any defamation deriving from their programs use.
htrp 3y ago
Looks like a wrapper around insightface along with a dash of GAN face smoothing (esrgan and gfpgan). Also using a pretty standard nsfw model that could be disabled in 1 line.
- falcor84 3y ago
  > nsfw model that could be disabled in 1 line. I would assume "that’s the point"
epups 3y ago
What is the difference to roop? Even the main dev seems to be the same.
- shmooper 3y ago
  looks like roop has bees discontinued https://github.com/s0md3v/roop https://github.com/s0md3v/roop
  - zo1 3y ago
    Quote: > The reason behind shutting the project down is that a developer with write access to the code published a problematic video to the documentation of the project. This happened while I was taking a break from the project in July-Aug 2023. It went unnoticed for 2 weeks until someone reached out to me to talk about this project. It was a complete breach of trust for me and I decided that I do not have the interest or time to oversee the development of a software with such ethical issues. Anyone have any idea what this problematic video is, or what caused this to happen?
    - codezero 3y ago
      It's linked to in the message, I don't know the context but my best guess is the image that was added is of a known celebrity or an underage person, but the context isn't clear from the thread to me, it could also just be that the person is topless (though nothing is visible) and the author has been proactive about making the program default to no nudity. I'm also not sure the images there are the ones that the original author is upset about since it looks like a branch where images were hosted was deleted.
    - iKlsR 3y ago
      It was literally the bust of a woman, no real nudity. Imagine an inch above cleavage upwards, I suspect the original guy who seemingly tries to please everyone if you check their replies on feedback [1] just wanted an excuse over time to discontinue for a while for numerous reasons (career, ethics & he was the face of it, 20k stars) [2]. (I also wouldn't necessarily want to be associated with something like this similar to the insightface guy due to the potential for abuse and it has probably grown a lot more than he expected [3]) and 90% of the new features were added by henry. The first version of roop was barely a derivation from the example code in insightface [4], it just added a gui. [1] - https://news.ycombinator.com/item?id=36117013 https://news.ycombinator.com/item?id=36117013, https://twitter.com/s0md3v/status/1663604795524149248 https://twitter.com/s0md3v/status/1663604795524149248 [2] - https://twitter.com/emilyx64/status/1663603738395951106 https://twitter.com/emilyx64/status/1663603738395951106 [3] - https://github.com/deepinsight/insightface/issues/2315#issuecomment-1569586531 https://github.com/deepinsight/insightface/issues/2315#issue... [4] - https://github.com/deepinsight/insightface/blob/master/examples/in_swapper/inswapper_main.py https://github.com/deepinsight/insightface/blob/master/examp...
_8j50 3y ago
Blackmirror episode: everyone has a brain implant which among other things makes anyone you look at, including yourself look ridiculously attractive, unless by law the implant is removed when you are convicted of a felony. The protagonist gets convicted only to find out he/she is really fat and ugly, only to find true beauty in another far and ugly person.
- ShamelessC 3y ago
  Pretty contrived.
- supermdguy 3y ago
  There's a great short story by Ted Chiang that explores a similar idea: https://waldyrious.neocities.org/ted_chiang/liking-what-you-see-a-documentary https://waldyrious.neocities.org/ted_chiang/liking-what-you-.... It's interesting to think about how much attractiveness plays into the way the world works.
- catiopatio 3y ago
  How about: After a landmark constitutional amendment guaranteeing absolute equity under the law, the government mandates the implantation of “equalizers” in all citizens at birth. These brain implants suppress intelligence to a standardized mean and distort visual perception, rendering all faces equally devoid of distinguishing beauty.
  - webmaven 3y ago
    Kurt Vonnegut wrote this story in 1961: https://en.m.wikipedia.org/wiki/Harrison_Bergeron https://en.m.wikipedia.org/wiki/Harrison_Bergeron
  - _8j50 3y ago
    And maybe the protagonist would find an exemption and turn out to be better looking and smarter which causes problems for him/her?
cchance 3y ago
Not gonna be impressed until something that can beat insightface-128 comes out open, shocked no open source teams have taken the challenge to do a 512 model train.
29athrowaway 3y ago
An ideal choice for people that do not like their face.
shivz45 3y ago
Insightface now using improved model but closed source via discord bot. https://github.com/deepinsight/insightface/issues/2294 https://github.com/deepinsight/insightface/issues/2294 https://github.com/deepinsight/insightface/issues/2315 https://github.com/deepinsight/insightface/issues/2315

73 points by pocketarc 3y ago

> It has a built-in check which prevents the program from working on inappropriate media including but not limited to nudity, graphic content, sensitive material such as war footage etc. This is noble, but git… open-source… forks…

azeemba 3y ago
Since face swapping tools crop.up frequently, what is their pitch? What are the non-abusive use cases for face swapping?
- Filligree 3y ago
  Putting yourself or a friend in a movie scene, for example.
  - fullspectrumdev 3y ago
    Lol, literally what I use it for half the time for meme reasons.
- carstenhag 3y ago
  Entertainment (memes). Trying out a new hairstyle matching your face.
  - falcor84 3y ago
    The hairstyle thing sounds like a killer feature, but I think that it would be relatively quickly overtaken by whoever makes it easier to create 3d models of yourself at metahuman-like level.
- woleium 3y ago
  Digital marketing agencies can make website team pages look much more professional without having to go to the expense of a photo shoot
  - CSSer 3y ago
    Perhaps this is a bit cheeky, but I think it'd be pretty hilarious if a company, intentionally or otherwise, used this to generate a bunch of uniform headshots that made all of the employees at a company look like they're in way better shape than they actually are.
  - flangola7 3y ago
    So the model and photographer lose their job but the company bottom line is unchanged.
- Tenoke 3y ago
  I use Roop (which this is a successor of) to make stablediffusion pictures of myself (e.g. for my slack avatar).
- fullspectrumdev 3y ago
  Amusement. Putting your mates in a film scene. Making silly memes. Etc. Not everything needs a “serious” usecase.
  - flangola7 3y ago
    It does where the negative use cases are very harmful. I can think of many fun projects I could pursue in my chemistry lab if only the precursors and equipment for mass producing nerve agents and high explosives were not tightly regulated.
throwitaway156 3y ago
At least that check is not hosted elsewhere and the author is clear from any defamation deriving from their programs use.

htrp 3y ago

Looks like a wrapper around insightface along with a dash of GAN face smoothing (esrgan and gfpgan). Also using a pretty standard nsfw model that could be disabled in 1 line.

falcor84 3y ago
> nsfw model that could be disabled in 1 line. I would assume "that’s the point"

epups 3y ago

What is the difference to roop? Even the main dev seems to be the same.

shmooper 3y ago
looks like roop has bees discontinued https://github.com/s0md3v/roop https://github.com/s0md3v/roop
- zo1 3y ago
  Quote: > The reason behind shutting the project down is that a developer with write access to the code published a problematic video to the documentation of the project. This happened while I was taking a break from the project in July-Aug 2023. It went unnoticed for 2 weeks until someone reached out to me to talk about this project. It was a complete breach of trust for me and I decided that I do not have the interest or time to oversee the development of a software with such ethical issues. Anyone have any idea what this problematic video is, or what caused this to happen?
  - codezero 3y ago
    It's linked to in the message, I don't know the context but my best guess is the image that was added is of a known celebrity or an underage person, but the context isn't clear from the thread to me, it could also just be that the person is topless (though nothing is visible) and the author has been proactive about making the program default to no nudity. I'm also not sure the images there are the ones that the original author is upset about since it looks like a branch where images were hosted was deleted.
  - iKlsR 3y ago
    It was literally the bust of a woman, no real nudity. Imagine an inch above cleavage upwards, I suspect the original guy who seemingly tries to please everyone if you check their replies on feedback [1] just wanted an excuse over time to discontinue for a while for numerous reasons (career, ethics & he was the face of it, 20k stars) [2]. (I also wouldn't necessarily want to be associated with something like this similar to the insightface guy due to the potential for abuse and it has probably grown a lot more than he expected [3]) and 90% of the new features were added by henry. The first version of roop was barely a derivation from the example code in insightface [4], it just added a gui. [1] - https://news.ycombinator.com/item?id=36117013 https://news.ycombinator.com/item?id=36117013, https://twitter.com/s0md3v/status/1663604795524149248 https://twitter.com/s0md3v/status/1663604795524149248 [2] - https://twitter.com/emilyx64/status/1663603738395951106 https://twitter.com/emilyx64/status/1663603738395951106 [3] - https://github.com/deepinsight/insightface/issues/2315#issuecomment-1569586531 https://github.com/deepinsight/insightface/issues/2315#issue... [4] - https://github.com/deepinsight/insightface/blob/master/examples/in_swapper/inswapper_main.py https://github.com/deepinsight/insightface/blob/master/examp...

_8j50 3y ago

Blackmirror episode: everyone has a brain implant which among other things makes anyone you look at, including yourself look ridiculously attractive, unless by law the implant is removed when you are convicted of a felony. The protagonist gets convicted only to find out he/she is really fat and ugly, only to find true beauty in another far and ugly person.

ShamelessC 3y ago
Pretty contrived.
supermdguy 3y ago
There's a great short story by Ted Chiang that explores a similar idea: https://waldyrious.neocities.org/ted_chiang/liking-what-you-see-a-documentary https://waldyrious.neocities.org/ted_chiang/liking-what-you-.... It's interesting to think about how much attractiveness plays into the way the world works.
catiopatio 3y ago
How about: After a landmark constitutional amendment guaranteeing absolute equity under the law, the government mandates the implantation of “equalizers” in all citizens at birth. These brain implants suppress intelligence to a standardized mean and distort visual perception, rendering all faces equally devoid of distinguishing beauty.
- webmaven 3y ago
  Kurt Vonnegut wrote this story in 1961: https://en.m.wikipedia.org/wiki/Harrison_Bergeron https://en.m.wikipedia.org/wiki/Harrison_Bergeron
- _8j50 3y ago
  And maybe the protagonist would find an exemption and turn out to be better looking and smarter which causes problems for him/her?

cchance 3y ago

Not gonna be impressed until something that can beat insightface-128 comes out open, shocked no open source teams have taken the challenge to do a 512 model train.

29athrowaway 3y ago

An ideal choice for people that do not like their face.

shivz45 3y ago

Insightface now using improved model but closed source via discord bot. https://github.com/deepinsight/insightface/issues/2294 https://github.com/deepinsight/insightface/issues/2294 https://github.com/deepinsight/insightface/issues/2315 https://github.com/deepinsight/insightface/issues/2315