4 ms·
> However, there are several important safety and ethical challenges remaining. Imagen Video and its frozen T5-XXL text encoder were trained on problematic data
by azinman2 4y ago
> However, there are several important safety and ethical challenges remaining. Imagen Video and its frozen T5-XXL text encoder were trained on problematic data. While our internal testing suggest much of explicit and violent content can be filtered out, there still exists social biases and stereotypes which are challenging to detect and filter. We have decided not to release the Imagen Video model or its source code until these concerns are mitigated.
The concerns cannot be mitigated. The cat's out of the bag. Russia has already used poor quality deep fakes in Ukraine to justify their war. This will only become bigger and bigger of an issue to the point where 'truth' is gone, nothing is trusted, and societies will continue to commit atrocities under false pretense.
- hatenberg 4y agoSomeone shot someone with a cheap gun, the cat is out of the bag, gun regulation is pointless, let's let the assault rifles go free is the most american thing I've read all day.
- concordDance 4y agoYou can't copy paste guns and distribute them for free on the internet. At least not yet.
- gundmc 4y agoSpeculation, but I think the most straightforward read of that statement is not about preventing this type technology from negatively impacting society broadly (since as you and others pointed out, there are numerous similar actors creating similar systems), but Google doesn't want to the bad publicity or legal risk of problematic outputs of their models. I think they're terrified to be honest.
- azinman2 4y agoI worry that everyone across academia and industry are creating these models as if they’re burning needs without any recognition of what’s happening collectively. It’s not neutral at all, yet everyone involved seems to think they can put in an “ethics” paragraph to absolve themselves. As we’ve seen in the last 20 years with technology (and certainly many technologies in the last 200 years before that), it simply isn’t true.
- dogcomplex 4y agoCryptographic trust (combinations of identity proofs, including passport, passwords, social and family networks of vouching, fingerprints, behavioral data, etc) will be the only way to trust any digital information very soon. If it's not vouched for by someone with proof that they're a real person, it's fake.
- azinman2 4y agoThat’s not how human nature works. Show a video that fits cognitive bias, and the non-technical non-sophisticated people of the world will believe it. And that’s assuming it’s even technically feasible to solve, which it likely isn’t.
- inkblotuniverse 4y agoGive it a generation, and the new norm will be that video on the internet is as likely to be a lie as text.
- virgildotcodes 4y agoYet people today still whole heartedly believe so many lies communicated in text.
- azinman2 4y agoAnd don’t forget that people who benefit from lies will adapt as well. There’s no escaping, but when you put something visual in front of someone your brain wants to believe it. Basically all these models are informational nuclear weapons being created, blueprints and all, and with distributed implementations mean anyone can and will use them.
- ImHereToVote 4y agoIs there any evidence to support the hypothesis that the Russian Federation has been behind the deep fakes? Or is it a case of the good old "common it's obvious, common, commooon"?
- azinman2 4y agoThey’re deep fakes of the Ukrainian president, obviously of poor quality, spoken in Russian and telling Ukrainian solders to put down their arms, and right now there’s only one country waging war against them/him. Would you like Putin himself to say he did it?
- orloffm 4y agoThe thread starter probably doesn't even know what he's referencing.
- spupy 4y ago> [...] there still exists social biases and stereotypes which are challenging to detect and filter. If Google filters them, wouldn't the result be still biased and stereotyped, just along Google's biases? "I reject your biases and substitute my own!"