5 ms·

I'm more concerned about Sora (and video-generating AI in general) being the final pour that cements us into our post-truth world. People will be swayed by AI-

I'm more concerned about Sora (and video-generating AI in general) being the final pour that cements us into our post-truth world. People will be swayed by AI-generated videos while also being convinced real videos are AI. I'm kinda terrified of the future of politics.

pmontra 1y ago
Maybe they'll have to tour and meet people in person because videos will be devoid of trust. On the other side we want to believe in something, so we'll believe in the video that will suit our beliefs. It's an interesting struggle.
- bilekas 1y ago
  Yeah I'm just as annoyed with the AI slop that's coming out as anyone, but the next generation of voters won't believe a thing and so they will be pushed towards believing what they see in real life like campaigners who go door to door etc. It could be a great thing and would give meaning to he electoral system again ironically!
  - kulahan 1y ago
    Honestly I can't see a solution beyond concentrating power to highly localized regions. Lots more mayors, city councils, etc. so there is a real chance you can meet someone who represents you. I don't fully believe anything I see on the internet that isn't backed up by at least two independent sources. Even then, I've probably been tricked at least once.
    - bilekas 1y ago
      It may come to that, where the federal power is less influential and there to mainly manage overall services of the nation etc, and then the local states let's say manage themselves, if I'm not wrong that was kind of the original idea of the great experiment. It doesn't sound inherently wrong untill you add tribalism into the mix where people are not working with eachother, but that seems to be the major push these days, at least that's the sentiment I get. Would that change, maybe not, but maybe it would lessen the power grabs that some small few seem to gravitate towards. I know if I wanted to influence the major elections, OpenAI, Google and Meta would be the first places I would go. That's a very small group of points of failure. Elections recently seem to be quite narrow, maybe they were before too though, but that kind of power is a silent soft power that really goes unchecked. If people are more in tune with being mislead, that power can slowly degrade.
- tinfoilhatter 1y ago
  Most members of the US congress and the current presidential administration, are already devoid of trust. I can't speak for other countries governments, but it seems to be a fairly common situation.
- Sohcahtoa82 1y ago
  > Maybe they'll have to tour and meet people in person That doesn't scale. During campaign season, they're already running as many rallies as they can. Outside the campaign train, smaller Town Hall events only reach what, a couple hundred people, tops? And at best, they might change the minds of a couple dozen people. EDIT: It's also worth mentioning that people generally don't seek to have their mind changed. Someone who is planning on voting for one candidate is extremely unlikely to go to a rally for the opposition.
ajuc 1y ago
Every breakthrough in information technology caused disruption in the historical sense (i.e. millions of deaths). From the writing, through organized religion, printing press, radio and tv, internet and now ai. Printing press and reformation wars is obvious, radio and totalitarianism is less known, internet and new populism is just starting to be recognized for what it is. Eventually we'll get it regulated and adjust to it. But in the meantime it's going to be a wild ride.
sixothree 1y ago
The willingness of people to believe misinformation today is astounding. They are already choosing to surround themselves with voices of hate and anger. I don't want to see what's next for them.
bonoboTP 1y ago
We will adjust. And guess what, before photography, people managed somehow. People gossiped all sorts of stuff, spread malicious runors and you had to guess what's a lie and what's not. The way people dealt with it was witness testimony and physical evidence.
- sofixa 1y ago
  > The way people dealt with it was witness testimony and physical evidence. Which are inapplicable today. > We will adjust Will we? Maybe years later... per event. It's finally now dawning on the majority of Britons that Brexit was a mistake they were lied about.
  - bonoboTP 1y ago
    That has nothing to do with GenAI.
    - sofixa 1y ago
      Yep, it's only made worse by it.
  - schnable 1y ago
    > Maybe years later... It is a concern... it took a few centuries for the printing press to spur the Catholic/Protestant wars and then finally resolve them.
  - pessimizer 1y ago
    > Which are inapplicable today. No, they are not.
  - wongarsu 1y ago
    Brexit is a great example how you can just lie by writing stuff on the side of a bus, no fake photos or videos required
    - sofixa 1y ago
daxfohl 1y ago
Most people's minds are already made up. All this does is add some confirmation bias so they can feel better about what they were already certain of. I don't think it fundamentally changes anyone's opinions.
CaptainOfCoit 1y ago
"See it to believe it" will once again be more important.
mentalgear 1y ago
Well, maybe it's less about Sora, but how they push the world towards making their next product essential: WorldCoin [0], Altman's blockchain token system (the one with the alien orb) to scan everybody's biometric fingerprint and serve as the only Source of Truth for the World - controlled by one private company. It's like the old saying: They create their own ecosystem. Circular stock market deals being the most obvious, but the WorldCoin has been for years in the making and Altman often described it as the only alternative in a post-truth world (the one he himself is making of course). [0] https://www.forbes.com.au/news/innovation/worldcoin-crypto-price-soars-on-back-of-openai-sora-release/ https://www.forbes.com.au/news/innovation/worldcoin-crypto-p...
renewiltord 1y ago
This is a non-concern. You can see videos where a specific thing happens where people will describe a different thing happening. Not some eyewitness off memory. You can look at a video and there will be people on Reddit saying stuff that didn’t happen. Then you can see any conversation about the video will be even more divorced from reality. None of this requires video manipulation. The majority of people are idiots on a grand scale. Just search any social media for PEMDAS and you will find hordes of people debating the value of 2 + 3 / 5 on all sorts of grounds. “It’s definitely 1. 2+3 =5 then by 5 is 1” stuff like that.
hombre_fatal 1y ago
The problem is that we're already post truth. Just consider how a screenshot of a tweet or made-up headline already spreads like a wildfire: https://x.com/elonmusk/status/1980221072512635117 https://x.com/elonmusk/status/1980221072512635117 Sora involves far more work than what is required to spread misinfo. Finally, people don't really care about the truth. They care about things that confirm their world view, or comfortable things. Or they dismiss things that are inconvenient for their tribe and focus on things that are inconvenient for other tribes.
- nothrabannosir 1y ago
  > Finally, people don't really care about the truth. That same link has two “reader notes” about truth. The lie is half way around the world etc, but that can also be explained by people’s short term instincts and reaction to outrage. It’s not mutually exclusive with caring about truth. Maybe I’m being uncharitable — did you mean something like “people don’t care about truth enough to let it stop them from giving into outrage”? Or..?
- FloorEgg 1y ago
  Assuming this is all true, what's the most optimistic view you can take looking ~20 years out? How could all of this wind up leading to a much more fair, kind, sustainable and prosperous future? Acknowledging risks is important, but where do YOU want all this to go?
  - Eisenstein 1y ago
    As adults already, we grew up with things that are either not relevant or give us the wrong responses to our heuristics. But the kids who grow up with this stuff will just integrate into their life and proceed. The society which results from that will be something we cannot predict as it will be alien to us. Whether it will be better or not -- probably not. Humans evolved to spend most of their time with a small group of trusted people. By removing ourselves from that we have created all sorts of problems that we just aren't really that equipped to deal with. If this is solvable or not has yet to be seen.
OJFord 1y ago
It just makes trusted/verified sources more important, and more people to care about it. I wouldn't be terrified for politics so much as the raised barrier to entry (and concentration) of the press - people will pay attention to the BBC, Guardian, Times, but not (even less so) independentjourno.com; those sources will be more sceptical of whistleblowers and freelance investigative contributions, etc.
Razengan 1y ago
Well, usually when there's a mass problem, some technology eventually eliminates it. Like cars making horse manure in cities a non-issue (https://www.youtube.com/watch?v=w61d-NBqafM https://www.youtube.com/watch?v=w61d-NBqafM) Maybe the solution to everybody lying would be some way to directly access a person's actual memories from their brains..
pdntspa 1y ago
Just yesterday I saw a Sora-generated video that purported to be someone filming a failed HIMARS missile failing and falling on stopped traffic and exploding on the 5 in Camp Pendleton on Saturday. (IRL they were doing some kind of live-fire drill and it did actually involve projectiles flying over the freeway.) While there were some debris instances IRL the freeway was completely shut down per the governors orders and nobody was harmed. (Had he not done this, that same debris may have hit motorists, so this was a good call on his part) You could see the "Sora" watermark in the video, but it was still popular enough to make it in my reels feed that is normally always a different kind of content. In this case whoever made that was sloppy enough to use a turnkey service like Sora. I can easily generate videos suitable for reels using my GPU and those programs don't (visibly) watermark. We are in for dark times. Who knows how many AI-generated propaganda videos are slipping under the radar because the operator is actually half-skilled.
- Sohcahtoa82 1y ago
  > I can easily generate videos suitable for reels using my GPU and those programs don't (visibly) watermark. Curious what you used. I have an RTX 5090 and I've tried using some local video generators and the results are absolute garbage unless I'm asking for something extremely simple and uncreative like "woman dancing in a field".
  - skirmish 1y ago
    A quick search found this example 18 second video generated on 3090: https://old.reddit.com/r/StableDiffusion/comments/1kp5jb8/dancing_plush/ https://old.reddit.com/r/StableDiffusion/comments/1kp5jb8/da... I am pretty sure what you want is doable on a 5090 with some effort but it will not be just a text prompt to video. More like input key frames as images and interpolate video between them.
highwaylights 1y ago
I'm surprised this isn't a bigger concern given that: For over a year now we've been at the point whereby a video of anyone saying or doing anything can be generated by anyone and put on the Internet, and it's only becoming more convincing (and rapidly) We've been living in a post-truth world for almost ten years, so it's now become normalized Almost half of the population has been conditioned to believe anything that supports their political alignment People will actually believe incredibly far-fetched things, and when the original video has been debunked, will still hold the belief because by that point the Internet has filled up with more garbage to support something they really want to believe It's a weird time to be alive
- cruffle_duffle 1y ago
  Absolutely! And don’t kid yourself into thinking you are immune from this either. You can find support of basically anything you want to believe. And your friendly LLM will be more than happy to confirm it too! Honestly it goes right back to philosophy and what truth even means. Is there even such a thing?
  - Eisenstein 1y ago
    People forget that critical thinking means thinking critically about everything, even things you already think are true because they fit into your worldview.
    - antod 1y ago
      Let alone the hordes who think "critical thinking" just means disagreeing with things.
  - Sohcahtoa82 1y ago
    > Honestly it goes right back to philosophy and what truth even means. Is there even such a thing? Truth absolutely is a thing. But sometimes, it's nuanced, and people don't like nuance. They want something they can say in a 280-character tweet that they can use to "destroy" someone online.
overvale 1y ago
Other people have said this, but I don’t think it’s going to be any different than living in a world where people can spread rumors orally or print lies with a printing press. We’ve been dealing with those challenges for a long time. Our ways of thinking and our courts understand that you can’t trust what people say and you can’t trust what you read. We’ve internalized that as a society. Looking back, there seems to have been a brief period of time when you could actually trust photographs and videos. I think in the long run, this period of time will be seen as a historical anomaly, and video will be no more trusted than the printed or spoken word is today.
truelson 1y ago
We are having a huge amount of technological change (we haven't even learned how to handle social media as a society yet...). We're experiencing a global loss in trust, and things may fall apart for a bit until our society develops a better immune system to such ills. It is scary. I think we may revert back to trusting only smaller groups of people, being skeptical of anything outside that group, becoming a bit more tribal. I hope without too many deleterious effects, but a lot could happen. But humans, as a species, are survivors. And we, with our thinking machines will figure out ultimately how to deal with it all. I just hope the pain of this transition is not catastrophic.
deleted 1y ago
[deleted]
robofanatic 1y ago
If you don’t like any thing digital (image/video/text) then it’s definitely AI generated. I guess AI has kind of killed the “democratization of news” introduced by social media.
csallen 1y ago
People have been tricked by counterfeits ever since the invention of writing (or even drawing) first made it possible for a person to communicate without being physically present. At that moment, it simultaneously became possible to create "deep fakes" by simply forging a signature and tricking readers as to who authored the information. And even before that, just with speaking, it was already possible to spread lies and misinformation, and such things happened frequently, often with disastrous consequences. Just think of all the witch hunts, false religions, and false rumors that have been spread through the history of mankind. All of this is to say that mankind is quite used to dealing with information that has questionable authorship, authenticity, or accuracy. And mankind is quite used to suffering as a result of these challenges. It's nothing particularly new that it's moving into a new media format (video), especially considering that this is a relatively new format in the history of mankind to begin with. (FWIW, the best defense against deep fakes has always been to pay attention to the source of information rather than just the content. A video about XYZ coming from XYZ's social media account is more likely to be accurate than if it comes from elsewhere. An article in the NYTimes that you read in the NYTimes is more likely to be authentic than a screenshot of an article you read from some social media account. Etc. It's not a perfect measure -- nothing is -- but I'd say it's the main reason we can have trust despite thousands of years of deep fakes.) IMO the fact that social media -- and the internet in general -- have decentralized media while also decoupling it from geography is less precedented and more worrisome.
kazinator 1y ago
Here is the thing: we should never have trusted photographs and motion pictures. Fakery isn't new, only the product of scale and quality at which it is becoming possible.
kazinator 1y ago
Being convinced that real videos are AI is arguably a better position than being convinced that real videos convey the iron-clad truth. Everything is manipulated or generated until proven otherwise.
anarticle 1y ago
I think their game theoretic aim was to completely discredit video online. Just as we don't accept text in general as truth or image when we see it, we are being flooded with completely fake vids so people can shake the idea that videos are truth. It smells of e/acc, effective altruist ethics which are not my favorite, but I don't work at OpenAI so I don't have a say I can only interpret. I agree, but we will likely continue down this road...
shnp 1y ago
Flawless AI generated videos will result in video footage not being trusted. This will simply take us back about 150 years to the time before the camera was common. The transition period may be painful though.
roadside_picnic 1y ago
> the final pour that cements us into our post-truth world. I find it a bit more concerning that anyone would not already understand how deeply we exist in a "post-truth" world. Every piece of information we've consumed for the last few decades has increasingly been shaped by algorithms optimizing someone else's target. But the real danger of post-truth is when there is a still enough of a veneer of truth that you can use distortions to effectively manipulate the public. Losing that veneer is essentially a collapse of the whole system, which will have consequences I don't think we can really understand. The pre and early days of social media were riddled with various "leaks" of private photos and video. But what does it mean to leak a nude photo of a celebrity when you can just as easily generate a photo that is indistinguishable? The entire reason leaks like that were so popular is precisely because people wanted a glimpse into something real about the private life of these screen personalities (otherwise 'leaks' and 'nude scenes' would have the same value). As image generation reaches the limit, it will be impossible to ever really distinguish between voyeurism and imagination. Similarly we live in an age of mass surveillance, but what does surveillance footage mean when it can be trivially faked. Think of how radicalizing surveillance footage has been over the past few decades. Consider for example the video of the Rodney King beating. Increasingly such a video could not be trusted. > I'm kinda terrified of the future of politics. If you aren't already terrified enough of the present of politics, then I wouldn't be worried about what Sora brings us tomorrow. I honestly think what we'll see soon is not increasingly more powerful authoritarian systems, but the break down of systems of control everywhere. As these systems over-extend themselves they will collapse. The peak of social media power was to not let it go further than it was a few years ago, Sora represents a larger breakdown of these systems of control.
- uvaursi 1y ago
  Agreed, but this is mostly coming from people who would normally discredit you bashing MSM as a kook/conspiracy theorist. People forget, or didn’t see, all the staged catastrophes in the 90s that were shortly afterwards pulled off the channel once someone pointed out something obvious (f.e. dolls instead of human victims, wrong location footage, and so on). But if you were there, and if you saw that, and then saw them pull it off and pretend like it didn’t happen for rest of the day, then this AI thing is a nothing burger.
ozgrakkurt 1y ago
Or people will just stop believing random things they see online. You are underestimating people imo.
jmkni 1y ago
For sure. I consider myself pretty on the ball when it comes to following this stuff, and even I've been caught off guard by some videos, I've seen videos on Reddit I thought were real until I realised what subreddit I was on

pmontra 1y ago

Maybe they'll have to tour and meet people in person because videos will be devoid of trust. On the other side we want to believe in something, so we'll believe in the video that will suit our beliefs. It's an interesting struggle.

bilekas 1y ago
Yeah I'm just as annoyed with the AI slop that's coming out as anyone, but the next generation of voters won't believe a thing and so they will be pushed towards believing what they see in real life like campaigners who go door to door etc. It could be a great thing and would give meaning to he electoral system again ironically!
- kulahan 1y ago
  Honestly I can't see a solution beyond concentrating power to highly localized regions. Lots more mayors, city councils, etc. so there is a real chance you can meet someone who represents you. I don't fully believe anything I see on the internet that isn't backed up by at least two independent sources. Even then, I've probably been tricked at least once.
  - bilekas 1y ago
    It may come to that, where the federal power is less influential and there to mainly manage overall services of the nation etc, and then the local states let's say manage themselves, if I'm not wrong that was kind of the original idea of the great experiment. It doesn't sound inherently wrong untill you add tribalism into the mix where people are not working with eachother, but that seems to be the major push these days, at least that's the sentiment I get. Would that change, maybe not, but maybe it would lessen the power grabs that some small few seem to gravitate towards. I know if I wanted to influence the major elections, OpenAI, Google and Meta would be the first places I would go. That's a very small group of points of failure. Elections recently seem to be quite narrow, maybe they were before too though, but that kind of power is a silent soft power that really goes unchecked. If people are more in tune with being mislead, that power can slowly degrade.
tinfoilhatter 1y ago
Most members of the US congress and the current presidential administration, are already devoid of trust. I can't speak for other countries governments, but it seems to be a fairly common situation.
Sohcahtoa82 1y ago
> Maybe they'll have to tour and meet people in person That doesn't scale. During campaign season, they're already running as many rallies as they can. Outside the campaign train, smaller Town Hall events only reach what, a couple hundred people, tops? And at best, they might change the minds of a couple dozen people. EDIT: It's also worth mentioning that people generally don't seek to have their mind changed. Someone who is planning on voting for one candidate is extremely unlikely to go to a rally for the opposition.

ajuc 1y ago

Every breakthrough in information technology caused disruption in the historical sense (i.e. millions of deaths). From the writing, through organized religion, printing press, radio and tv, internet and now ai. Printing press and reformation wars is obvious, radio and totalitarianism is less known, internet and new populism is just starting to be recognized for what it is. Eventually we'll get it regulated and adjust to it. But in the meantime it's going to be a wild ride.

sixothree 1y ago

The willingness of people to believe misinformation today is astounding. They are already choosing to surround themselves with voices of hate and anger. I don't want to see what's next for them.

bonoboTP 1y ago

We will adjust. And guess what, before photography, people managed somehow. People gossiped all sorts of stuff, spread malicious runors and you had to guess what's a lie and what's not. The way people dealt with it was witness testimony and physical evidence.

sofixa 1y ago
> The way people dealt with it was witness testimony and physical evidence. Which are inapplicable today. > We will adjust Will we? Maybe years later... per event. It's finally now dawning on the majority of Britons that Brexit was a mistake they were lied about.
- bonoboTP 1y ago
  That has nothing to do with GenAI.
  - sofixa 1y ago
    Yep, it's only made worse by it.
- schnable 1y ago
  > Maybe years later... It is a concern... it took a few centuries for the printing press to spur the Catholic/Protestant wars and then finally resolve them.
- pessimizer 1y ago
  > Which are inapplicable today. No, they are not.
- wongarsu 1y ago
  Brexit is a great example how you can just lie by writing stuff on the side of a bus, no fake photos or videos required
  - sofixa 1y ago

daxfohl 1y ago

Most people's minds are already made up. All this does is add some confirmation bias so they can feel better about what they were already certain of. I don't think it fundamentally changes anyone's opinions.

CaptainOfCoit 1y ago

"See it to believe it" will once again be more important.

mentalgear 1y ago

Well, maybe it's less about Sora, but how they push the world towards making their next product essential: WorldCoin [0], Altman's blockchain token system (the one with the alien orb) to scan everybody's biometric fingerprint and serve as the only Source of Truth for the World - controlled by one private company. It's like the old saying: They create their own ecosystem. Circular stock market deals being the most obvious, but the WorldCoin has been for years in the making and Altman often described it as the only alternative in a post-truth world (the one he himself is making of course). [0] https://www.forbes.com.au/news/innovation/worldcoin-crypto-price-soars-on-back-of-openai-sora-release/ https://www.forbes.com.au/news/innovation/worldcoin-crypto-p...

renewiltord 1y ago

This is a non-concern. You can see videos where a specific thing happens where people will describe a different thing happening. Not some eyewitness off memory. You can look at a video and there will be people on Reddit saying stuff that didn’t happen. Then you can see any conversation about the video will be even more divorced from reality. None of this requires video manipulation. The majority of people are idiots on a grand scale. Just search any social media for PEMDAS and you will find hordes of people debating the value of 2 + 3 / 5 on all sorts of grounds. “It’s definitely 1. 2+3 =5 then by 5 is 1” stuff like that.

hombre_fatal 1y ago

The problem is that we're already post truth. Just consider how a screenshot of a tweet or made-up headline already spreads like a wildfire: https://x.com/elonmusk/status/1980221072512635117 https://x.com/elonmusk/status/1980221072512635117 Sora involves far more work than what is required to spread misinfo. Finally, people don't really care about the truth. They care about things that confirm their world view, or comfortable things. Or they dismiss things that are inconvenient for their tribe and focus on things that are inconvenient for other tribes.

nothrabannosir 1y ago
> Finally, people don't really care about the truth. That same link has two “reader notes” about truth. The lie is half way around the world etc, but that can also be explained by people’s short term instincts and reaction to outrage. It’s not mutually exclusive with caring about truth. Maybe I’m being uncharitable — did you mean something like “people don’t care about truth enough to let it stop them from giving into outrage”? Or..?
FloorEgg 1y ago
Assuming this is all true, what's the most optimistic view you can take looking ~20 years out? How could all of this wind up leading to a much more fair, kind, sustainable and prosperous future? Acknowledging risks is important, but where do YOU want all this to go?
- Eisenstein 1y ago
  As adults already, we grew up with things that are either not relevant or give us the wrong responses to our heuristics. But the kids who grow up with this stuff will just integrate into their life and proceed. The society which results from that will be something we cannot predict as it will be alien to us. Whether it will be better or not -- probably not. Humans evolved to spend most of their time with a small group of trusted people. By removing ourselves from that we have created all sorts of problems that we just aren't really that equipped to deal with. If this is solvable or not has yet to be seen.

OJFord 1y ago

It just makes trusted/verified sources more important, and more people to care about it. I wouldn't be terrified for politics so much as the raised barrier to entry (and concentration) of the press - people will pay attention to the BBC, Guardian, Times, but not (even less so) independentjourno.com; those sources will be more sceptical of whistleblowers and freelance investigative contributions, etc.

Razengan 1y ago

Well, usually when there's a mass problem, some technology eventually eliminates it. Like cars making horse manure in cities a non-issue (https://www.youtube.com/watch?v=w61d-NBqafM https://www.youtube.com/watch?v=w61d-NBqafM) Maybe the solution to everybody lying would be some way to directly access a person's actual memories from their brains..

pdntspa 1y ago

Just yesterday I saw a Sora-generated video that purported to be someone filming a failed HIMARS missile failing and falling on stopped traffic and exploding on the 5 in Camp Pendleton on Saturday. (IRL they were doing some kind of live-fire drill and it did actually involve projectiles flying over the freeway.) While there were some debris instances IRL the freeway was completely shut down per the governors orders and nobody was harmed. (Had he not done this, that same debris may have hit motorists, so this was a good call on his part) You could see the "Sora" watermark in the video, but it was still popular enough to make it in my reels feed that is normally always a different kind of content. In this case whoever made that was sloppy enough to use a turnkey service like Sora. I can easily generate videos suitable for reels using my GPU and those programs don't (visibly) watermark. We are in for dark times. Who knows how many AI-generated propaganda videos are slipping under the radar because the operator is actually half-skilled.

Sohcahtoa82 1y ago
> I can easily generate videos suitable for reels using my GPU and those programs don't (visibly) watermark. Curious what you used. I have an RTX 5090 and I've tried using some local video generators and the results are absolute garbage unless I'm asking for something extremely simple and uncreative like "woman dancing in a field".
- skirmish 1y ago
  A quick search found this example 18 second video generated on 3090: https://old.reddit.com/r/StableDiffusion/comments/1kp5jb8/dancing_plush/ https://old.reddit.com/r/StableDiffusion/comments/1kp5jb8/da... I am pretty sure what you want is doable on a 5090 with some effort but it will not be just a text prompt to video. More like input key frames as images and interpolate video between them.

highwaylights 1y ago

I'm surprised this isn't a bigger concern given that: For over a year now we've been at the point whereby a video of anyone saying or doing anything can be generated by anyone and put on the Internet, and it's only becoming more convincing (and rapidly) We've been living in a post-truth world for almost ten years, so it's now become normalized Almost half of the population has been conditioned to believe anything that supports their political alignment People will actually believe incredibly far-fetched things, and when the original video has been debunked, will still hold the belief because by that point the Internet has filled up with more garbage to support something they really want to believe It's a weird time to be alive

cruffle_duffle 1y ago
Absolutely! And don’t kid yourself into thinking you are immune from this either. You can find support of basically anything you want to believe. And your friendly LLM will be more than happy to confirm it too! Honestly it goes right back to philosophy and what truth even means. Is there even such a thing?
- Eisenstein 1y ago
  People forget that critical thinking means thinking critically about everything, even things you already think are true because they fit into your worldview.
  - antod 1y ago
    Let alone the hordes who think "critical thinking" just means disagreeing with things.
- Sohcahtoa82 1y ago
  > Honestly it goes right back to philosophy and what truth even means. Is there even such a thing? Truth absolutely is a thing. But sometimes, it's nuanced, and people don't like nuance. They want something they can say in a 280-character tweet that they can use to "destroy" someone online.

overvale 1y ago

Other people have said this, but I don’t think it’s going to be any different than living in a world where people can spread rumors orally or print lies with a printing press. We’ve been dealing with those challenges for a long time. Our ways of thinking and our courts understand that you can’t trust what people say and you can’t trust what you read. We’ve internalized that as a society. Looking back, there seems to have been a brief period of time when you could actually trust photographs and videos. I think in the long run, this period of time will be seen as a historical anomaly, and video will be no more trusted than the printed or spoken word is today.

truelson 1y ago

We are having a huge amount of technological change (we haven't even learned how to handle social media as a society yet...). We're experiencing a global loss in trust, and things may fall apart for a bit until our society develops a better immune system to such ills. It is scary. I think we may revert back to trusting only smaller groups of people, being skeptical of anything outside that group, becoming a bit more tribal. I hope without too many deleterious effects, but a lot could happen. But humans, as a species, are survivors. And we, with our thinking machines will figure out ultimately how to deal with it all. I just hope the pain of this transition is not catastrophic.

deleted 1y ago

[deleted]

robofanatic 1y ago

If you don’t like any thing digital (image/video/text) then it’s definitely AI generated. I guess AI has kind of killed the “democratization of news” introduced by social media.

csallen 1y ago

People have been tricked by counterfeits ever since the invention of writing (or even drawing) first made it possible for a person to communicate without being physically present. At that moment, it simultaneously became possible to create "deep fakes" by simply forging a signature and tricking readers as to who authored the information. And even before that, just with speaking, it was already possible to spread lies and misinformation, and such things happened frequently, often with disastrous consequences. Just think of all the witch hunts, false religions, and false rumors that have been spread through the history of mankind. All of this is to say that mankind is quite used to dealing with information that has questionable authorship, authenticity, or accuracy. And mankind is quite used to suffering as a result of these challenges. It's nothing particularly new that it's moving into a new media format (video), especially considering that this is a relatively new format in the history of mankind to begin with. (FWIW, the best defense against deep fakes has always been to pay attention to the source of information rather than just the content. A video about XYZ coming from XYZ's social media account is more likely to be accurate than if it comes from elsewhere. An article in the NYTimes that you read in the NYTimes is more likely to be authentic than a screenshot of an article you read from some social media account. Etc. It's not a perfect measure -- nothing is -- but I'd say it's the main reason we can have trust despite thousands of years of deep fakes.) IMO the fact that social media -- and the internet in general -- have decentralized media while also decoupling it from geography is less precedented and more worrisome.

kazinator 1y ago

Here is the thing: we should never have trusted photographs and motion pictures. Fakery isn't new, only the product of scale and quality at which it is becoming possible.

kazinator 1y ago

Being convinced that real videos are AI is arguably a better position than being convinced that real videos convey the iron-clad truth. Everything is manipulated or generated until proven otherwise.

anarticle 1y ago

I think their game theoretic aim was to completely discredit video online. Just as we don't accept text in general as truth or image when we see it, we are being flooded with completely fake vids so people can shake the idea that videos are truth. It smells of e/acc, effective altruist ethics which are not my favorite, but I don't work at OpenAI so I don't have a say I can only interpret. I agree, but we will likely continue down this road...

shnp 1y ago

Flawless AI generated videos will result in video footage not being trusted. This will simply take us back about 150 years to the time before the camera was common. The transition period may be painful though.

roadside_picnic 1y ago

> the final pour that cements us into our post-truth world. I find it a bit more concerning that anyone would not already understand how deeply we exist in a "post-truth" world. Every piece of information we've consumed for the last few decades has increasingly been shaped by algorithms optimizing someone else's target. But the real danger of post-truth is when there is a still enough of a veneer of truth that you can use distortions to effectively manipulate the public. Losing that veneer is essentially a collapse of the whole system, which will have consequences I don't think we can really understand. The pre and early days of social media were riddled with various "leaks" of private photos and video. But what does it mean to leak a nude photo of a celebrity when you can just as easily generate a photo that is indistinguishable? The entire reason leaks like that were so popular is precisely because people wanted a glimpse into something real about the private life of these screen personalities (otherwise 'leaks' and 'nude scenes' would have the same value). As image generation reaches the limit, it will be impossible to ever really distinguish between voyeurism and imagination. Similarly we live in an age of mass surveillance, but what does surveillance footage mean when it can be trivially faked. Think of how radicalizing surveillance footage has been over the past few decades. Consider for example the video of the Rodney King beating. Increasingly such a video could not be trusted. > I'm kinda terrified of the future of politics. If you aren't already terrified enough of the present of politics, then I wouldn't be worried about what Sora brings us tomorrow. I honestly think what we'll see soon is not increasingly more powerful authoritarian systems, but the break down of systems of control everywhere. As these systems over-extend themselves they will collapse. The peak of social media power was to not let it go further than it was a few years ago, Sora represents a larger breakdown of these systems of control.

uvaursi 1y ago
Agreed, but this is mostly coming from people who would normally discredit you bashing MSM as a kook/conspiracy theorist. People forget, or didn’t see, all the staged catastrophes in the 90s that were shortly afterwards pulled off the channel once someone pointed out something obvious (f.e. dolls instead of human victims, wrong location footage, and so on). But if you were there, and if you saw that, and then saw them pull it off and pretend like it didn’t happen for rest of the day, then this AI thing is a nothing burger.

ozgrakkurt 1y ago

Or people will just stop believing random things they see online. You are underestimating people imo.

jmkni 1y ago

For sure. I consider myself pretty on the ball when it comes to following this stuff, and even I've been caught off guard by some videos, I've seen videos on Reddit I thought were real until I realised what subreddit I was on