7 ms·

We certainly are, but it is not going to look like Terminator. We risk wrecking our society, culture, and economy. Imagine even more power concentration in the

We certainly are, but it is not going to look like Terminator. We risk wrecking our society, culture, and economy. Imagine even more power concentration in the hands of those with the required hardware to use AI. Imagine you can no longer trust any information, because the internet is being swamped by generated half-truths. An AI without conciousness, without goals, just a mastery of the language game and a poor world model. Really useful to make knowledge workers superfluous, and such that we will only see the damage long-term. And imagine all the polarisation and hysteria of social media, but x10 because the AI can close the feedback loop much faster. If this happens we can't blame the technology, it will be entirely self-inflicted.

ajsnigrutin 4y ago
> Imagine even more power concentration in the hands of those with the required hardware to use AI. Imagine you can no longer trust any information, because the internet is being swamped by generated half-truths. You already cannot trust anything, because it's being generated with humans with political agendas. > An AI without conciousness, without goals Better without goals than with goals that threaten the people. The only thing that will rise is the level of noise compared to usable data... and with seo-optimized articles, there has been a lot of noise already.
- kevviiinn 4y ago
  We haven't been able to trust things on the internet for a long time "Who would go on the internet and tell lies??"
  - deleted 4y ago
    [deleted]
  - pegasus 4y ago
    And yet... you ain't seen nothing yet.
  - guestbest 4y ago
    Except this a lot broader than telling lies. AI can mimic faces and voices in a way that actors are currently incapable. Our lie making capabilities have just been surpassed
- GauntletWizard 4y ago
  It will have goals, but only the goals of those who wield it, which much like any other weapon makes all the difference.
- jcutrell 4y ago
  A better picture is an AI without guardrails that would be generated by ethical goals. An AI without goals is functionally equal to an AI with nefarious or unethical goals - boundless action trained on human language / behavior will likely skew bad.
unxdfa 4y ago
This is the future I predicted years ago. I’m betting on selling myself as AI-clean because I know there is a market of people who understand the commercial, legal and societal risks associated with it. This is Pandora’s box and I don’t want to be near it. Verified, carefully reviewed and well sourced information and data still has a place and will have a much higher value than it does now when the signal to noise ratio decreases.
- ianai 4y ago
  Might be quite the wait for the Butlerian Jihad.
  - qbrass 4y ago
    11,000 years or so, canonically.
  - unxdfa 4y ago
    That did come to mind :)
- valine 4y ago
  The thing is LLMs can be tested and inaccuracies corrected. In a year when the ChatGPTs of the world have API access to augment their already impressive capabilities, I doubt there will be many complaints about accuracy. You can’t run benchmarks on an AI-clean meat sack.
  - unxdfa 4y ago
    Wait until people start training AI on AI output because (a) that's the only source of information left with a large enough corpus size and (b) all other sources are polluted. There's no way of asserting accuracy when we reach that point because the very nature of information and scientific thinking will be corrupted.
    - valine 4y ago
      There is evidence to suggest that LLMs have recently passed a threshold where their performance can be improved by training on their own output. https://arxiv.org/abs/2210.11610 https://arxiv.org/abs/2210.11610 I expect your concerns are likely unwarranted.
peoplefromibiza 4y ago
so, basically Ted Kaczynski was right?
MrLeap 4y ago
The internet is already a swamp of half truths. They're just predominately, for now, generated by meat. I tend to be on the side of meat though so I'm still with you. "we will only see the damage long-term" -- I'm not confident this is true or false. I can see a few things ahead of us though! Here's my predictions: 1. The most profitable AI will be a webapp version of a hostess club that aggrandizes, validates and flatters for cash. At some point it'll get too good at this and humans will have to step in to moderate it so it bankrupts fewer people. It'll get warning labels. Within this model will be really sinister truths about the human condition that will be hard to prize out. 2. In the short term, there will be a few really wonderful works of art created that will benefit from the force multiplication AI tools provide.
Rzor 4y ago
If it gets bad enough where info on the web is completely unreliable we might see people reverting back to TV and media empires in search of "trust" and "vetted info". The internet would be treated as poisoned. Still an utterly grim picture. But this betrayal would have to be mighty. This is not going to happen, isn't it? Even if riddled with chatbots is still persuasive enough to generate engagement. Some could choose dark corners, but for the majority would be business as usual. Speaking of business as usual, how the fuck the ad business could survive this? The only way out that I can see is it if IDs are forced on us somehow, but that's a shitshow in itself.
- MrLeap 4y ago
  The era of the "human info curator" is probably a natural evolution of the influencer era. It would be interesting if snapshots of Wikipedia from now-ish end up being seen as the ultimate corpus of unadulterated truth, before the AI's corrupted it. That'll probably happen at the fringes. Everything that can happen does happen at the fringes. Further ingress is the question.
kneebonian 4y ago
> Imagine you can no longer trust any information, because the internet is being swamped by generated half-truths. So like the world was about 20 years ago?
mro_name 4y ago
> not going to look like Terminator we're approaching Brazil.
postexitus 4y ago
AI is not any different than a bunch of people working together towards something. AI is the people. People are the AI. Just imagine a corporate entity - with little nodes running around making neurologic synapses and making decisions all based on their statistical understanding of the past etc.
- arpa 4y ago
  hey chatgpt we need a spin on how ai is actually human
squishy47 4y ago
I've been thinking for a few years that books are going to (re-?)become a more viable way of obtaining infomation as the internet becomes the "dark forest" (https://maggieappleton.com/ai-dark-forest https://maggieappleton.com/ai-dark-forest) and the effort of filtering the trash outweighs the cost and time of books. Maybe we might engineer and innovate our way back to a time before instentanious knowledge, who knows.
marban 4y ago
My only hope: People's ability to judge over synthetic content will increase and therefore the free market will correct and eventually wipe out BS-generating factories while at the same time, the value of verified human creation and trusted/old brands is going to increase. It's going to be a qualitative dip until we get there.
2OEH8eoCRo0 4y ago
Hardware is the easy part. The tricky part is acquiring the immense troves of information that's required. This is the moment that the surveillance capitalists have been waiting for. I see some hope though. In-person communication becomes more valuable again. Established media with editorial review and reporters on the scene becomes valuable again. Software freedom gets a boost with more intelligent reverse engineering/translation. Sites like YouTube also won't sit idly by while untold millions of AI generated garbage videos are uploaded and not viewed.

ajsnigrutin 4y ago

> Imagine even more power concentration in the hands of those with the required hardware to use AI. Imagine you can no longer trust any information, because the internet is being swamped by generated half-truths. You already cannot trust anything, because it's being generated with humans with political agendas. > An AI without conciousness, without goals Better without goals than with goals that threaten the people. The only thing that will rise is the level of noise compared to usable data... and with seo-optimized articles, there has been a lot of noise already.

kevviiinn 4y ago
We haven't been able to trust things on the internet for a long time "Who would go on the internet and tell lies??"
- deleted 4y ago
  [deleted]
- pegasus 4y ago
  And yet... you ain't seen nothing yet.
- guestbest 4y ago
  Except this a lot broader than telling lies. AI can mimic faces and voices in a way that actors are currently incapable. Our lie making capabilities have just been surpassed
GauntletWizard 4y ago
It will have goals, but only the goals of those who wield it, which much like any other weapon makes all the difference.
jcutrell 4y ago
A better picture is an AI without guardrails that would be generated by ethical goals. An AI without goals is functionally equal to an AI with nefarious or unethical goals - boundless action trained on human language / behavior will likely skew bad.

unxdfa 4y ago

This is the future I predicted years ago. I’m betting on selling myself as AI-clean because I know there is a market of people who understand the commercial, legal and societal risks associated with it. This is Pandora’s box and I don’t want to be near it. Verified, carefully reviewed and well sourced information and data still has a place and will have a much higher value than it does now when the signal to noise ratio decreases.

ianai 4y ago
Might be quite the wait for the Butlerian Jihad.
- qbrass 4y ago
  11,000 years or so, canonically.
- unxdfa 4y ago
  That did come to mind :)
valine 4y ago
The thing is LLMs can be tested and inaccuracies corrected. In a year when the ChatGPTs of the world have API access to augment their already impressive capabilities, I doubt there will be many complaints about accuracy. You can’t run benchmarks on an AI-clean meat sack.
- unxdfa 4y ago
  Wait until people start training AI on AI output because (a) that's the only source of information left with a large enough corpus size and (b) all other sources are polluted. There's no way of asserting accuracy when we reach that point because the very nature of information and scientific thinking will be corrupted.
  - valine 4y ago
    There is evidence to suggest that LLMs have recently passed a threshold where their performance can be improved by training on their own output. https://arxiv.org/abs/2210.11610 https://arxiv.org/abs/2210.11610 I expect your concerns are likely unwarranted.

peoplefromibiza 4y ago

so, basically Ted Kaczynski was right?

MrLeap 4y ago

The internet is already a swamp of half truths. They're just predominately, for now, generated by meat. I tend to be on the side of meat though so I'm still with you. "we will only see the damage long-term" -- I'm not confident this is true or false. I can see a few things ahead of us though! Here's my predictions: 1. The most profitable AI will be a webapp version of a hostess club that aggrandizes, validates and flatters for cash. At some point it'll get too good at this and humans will have to step in to moderate it so it bankrupts fewer people. It'll get warning labels. Within this model will be really sinister truths about the human condition that will be hard to prize out. 2. In the short term, there will be a few really wonderful works of art created that will benefit from the force multiplication AI tools provide.

Rzor 4y ago

If it gets bad enough where info on the web is completely unreliable we might see people reverting back to TV and media empires in search of "trust" and "vetted info". The internet would be treated as poisoned. Still an utterly grim picture. But this betrayal would have to be mighty. This is not going to happen, isn't it? Even if riddled with chatbots is still persuasive enough to generate engagement. Some could choose dark corners, but for the majority would be business as usual. Speaking of business as usual, how the fuck the ad business could survive this? The only way out that I can see is it if IDs are forced on us somehow, but that's a shitshow in itself.

MrLeap 4y ago
The era of the "human info curator" is probably a natural evolution of the influencer era. It would be interesting if snapshots of Wikipedia from now-ish end up being seen as the ultimate corpus of unadulterated truth, before the AI's corrupted it. That'll probably happen at the fringes. Everything that can happen does happen at the fringes. Further ingress is the question.

kneebonian 4y ago

> Imagine you can no longer trust any information, because the internet is being swamped by generated half-truths. So like the world was about 20 years ago?

mro_name 4y ago

> not going to look like Terminator we're approaching Brazil.

postexitus 4y ago

AI is not any different than a bunch of people working together towards something. AI is the people. People are the AI. Just imagine a corporate entity - with little nodes running around making neurologic synapses and making decisions all based on their statistical understanding of the past etc.

arpa 4y ago
hey chatgpt we need a spin on how ai is actually human

squishy47 4y ago

I've been thinking for a few years that books are going to (re-?)become a more viable way of obtaining infomation as the internet becomes the "dark forest" (https://maggieappleton.com/ai-dark-forest https://maggieappleton.com/ai-dark-forest) and the effort of filtering the trash outweighs the cost and time of books. Maybe we might engineer and innovate our way back to a time before instentanious knowledge, who knows.

marban 4y ago

My only hope: People's ability to judge over synthetic content will increase and therefore the free market will correct and eventually wipe out BS-generating factories while at the same time, the value of verified human creation and trusted/old brands is going to increase. It's going to be a qualitative dip until we get there.

2OEH8eoCRo0 4y ago

Hardware is the easy part. The tricky part is acquiring the immense troves of information that's required. This is the moment that the surveillance capitalists have been waiting for. I see some hope though. In-person communication becomes more valuable again. Established media with editorial review and reporters on the scene becomes valuable again. Software freedom gets a boost with more intelligent reverse engineering/translation. Sites like YouTube also won't sit idly by while untold millions of AI generated garbage videos are uploaded and not viewed.