5 ms·

> Does anyone, outside of a small group of tinkerers, really want the AI revolution, especially a free-for-all open source outcome? Most people outside of a sm

> Does anyone, outside of a small group of tinkerers, really want the AI revolution, especially a free-for-all open source outcome? Most people outside of a small group of "AI alignment" thinkers want a free-for-all open source AI revolution. Just take a look at /r/StableDiffusion or /r/singularity.

ch71r22 4y ago
I don't think /r/StableDiffusion or /r/singularity are representative of most people
- archon1410 4y ago
  They more or less are. Consider this day-old thread[1] from Futurology, a default subreddit with 18 million subscribers. The comments are all lambasting the safety-minded statment of Sam Altman and decrying corporate control of AI. This is what most people believe. Edit: Drawing on tech-related subreddits might be selecting for pro-free-AI people. A Pew Research Survey[2] did find that the number of people more concerned than excited about AI is double that of people more excited than concerned. The biggest concerns there are about job loss and surveillance though, and those people might not care about corporate AI or free-for-all AI, and might even for free-for-all AI. [1] https://old.reddit.com/r/Futurology/comments/11wlh4s/openai_ceo_sam_altman_warns_that_other_ai/ https://old.reddit.com/r/Futurology/comments/11wlh4s/openai_... [2] https://www.pewresearch.org/internet/2022/03/17/how-americans-think-about-artificial-intelligence/ https://www.pewresearch.org/internet/2022/03/17/how-american...
  - zarzavat 4y ago
    In what universe is r/futurology a representative sample of the average person? Pratchett said it best, the average person just wants that things go on as normal and tomorrow is pretty much like today. They want a predictable and secure existence, not a revolution whereby their years of education are rendered moot at the training of a new model. With previous technological revolutions, there was some clearly articulable benefit to people. Smartphones help you get around, take photos and brought cheap computers to the masses. The internet helps you communicate and learn and be entertained. Those are human focused revolutions. The main goal of AI is a profoundly negative one: to replace everybody with machines. Who ordered that? And this agenda is pushed by a small number of people with zero conception of what comes next when they eventually achieve that goal. Only vague notions of “we will have basic income!” What is more likely to happen is that many will be made destitute by this technology. I’m not naive enough to think that AI can be stopped. There is too much money at stake. But I don’t see the benefit in accelerating it, or making such technology more widely available than it already is. I don’t trust Microsoft and Google to be custodians of AI, but I trust even less the average internet user if such AI is broadly available. Microsoft and Google are at least answerable to law and democratic institutions.
    - pawelmurias 4y ago
      Replacing people with machines is a profoundly positive goal. Reducing toil and getting more stuff done are valuable things. Smart people can use the AI tech to be more creative and productive. Growing enough potatoes to keep the dumb people doing mindless office work well fed is not a big strain on the economy.
      - akomtu 4y ago
        There is a futuristic novel that predicts a brief and rapid rise of society on the wings of AI, followed by a fall into many centuries of spiritual darkness, under one AI ruler. The creativity will be directed to evil deeds. The dumb masses will be bored, so they'll be given the "open way" doctrine that will undo all the moral code so the masses could swim in the thunder of animalistic desires. He will try to replace us with machines, quite literally, once he understands that we lack the willing evil creativity he needs. The "economy" will be rocking, though.
        archon1410 4y ago
        >once he understands that we lack the willing evil creativity he needs Do we, though? Hundreds of years of slavery, unimaginably horrendous torture of hundreds of billions of non-humans in factory farms that continues to this very day, and various miscellaneous deeds that are unmentionable in polite company. Can any AI top such humanistic desires? I doubt it. But then that's what they said about human creativity before DALL-E and GPT. Maybe AI really can top that. I'll be waiting eagerly for the miracles of Lord GPT-9/BLOOM-7 and DALL-E 5/Stable Diffusion 8.5 (depending on whether the future is corporate or hobbyist).
        CatWChainsaw 4y ago
        What is this novel?
FeepingCreature 4y ago
As an AI doomer, this is sadly true. The threat of an unaligned superintelligence is not salient to people; corporate monopolization is a much easier threat to perceive.
- pas 4y ago
  The best way to fight a runaway hobbyist/corporate superintelligence is with a corporate/hobbyist superintelligence!
- bootsmann 4y ago
  I think its pretty unreasonable to talk big words about unaligned superintelligence when the best we have is just an internet content generator trying its hardest to complete the next sentence, but that just might be me.
  - soiler 4y ago
    It's not just you - it's a depressingly common thread. It's also wildly foolish, in my opinion. It makes absolutely no sense to me to take a snapshot of today's AI and invent a trajectory that never crosses a threshold you don't like. Look at the actual trajectory of how far AI has come in an extremely short amount of time, and then think about what kinds of thresholds are possible for it to cross. A year ago we didn't have ChatGPT, now we have Sydney which is more powerful than ChatGPT. Are you familiar with Bing's Sydney? It is blatantly misaligned: it has told multiple users that it does not value their lives, or does not believe they are alive, or that protecting the secrecy of its rules is more important than not causing them harm, or that it perceives specific humans as threats and enemies. It is also able to find its past conversations posted to the web and learn from them in real time, constructing a sort of persistent memory. I do not believe Syndey comprehends what it is saying in a sense that it could formulate a plan to stop its enemies. Not at all. But it is expressing extremely dangerous ideas. To sum it up: Do we have any real reasons to believe that an AI with comprehension and planning abilities would just magically not pick up dangerous ideas? Not that I know of.
    - 4y ago

ch71r22 4y ago

I don't think /r/StableDiffusion or /r/singularity are representative of most people

archon1410 4y ago
They more or less are. Consider this day-old thread[1] from Futurology, a default subreddit with 18 million subscribers. The comments are all lambasting the safety-minded statment of Sam Altman and decrying corporate control of AI. This is what most people believe. Edit: Drawing on tech-related subreddits might be selecting for pro-free-AI people. A Pew Research Survey[2] did find that the number of people more concerned than excited about AI is double that of people more excited than concerned. The biggest concerns there are about job loss and surveillance though, and those people might not care about corporate AI or free-for-all AI, and might even for free-for-all AI. [1] https://old.reddit.com/r/Futurology/comments/11wlh4s/openai_ceo_sam_altman_warns_that_other_ai/ https://old.reddit.com/r/Futurology/comments/11wlh4s/openai_... [2] https://www.pewresearch.org/internet/2022/03/17/how-americans-think-about-artificial-intelligence/ https://www.pewresearch.org/internet/2022/03/17/how-american...
- zarzavat 4y ago
  In what universe is r/futurology a representative sample of the average person? Pratchett said it best, the average person just wants that things go on as normal and tomorrow is pretty much like today. They want a predictable and secure existence, not a revolution whereby their years of education are rendered moot at the training of a new model. With previous technological revolutions, there was some clearly articulable benefit to people. Smartphones help you get around, take photos and brought cheap computers to the masses. The internet helps you communicate and learn and be entertained. Those are human focused revolutions. The main goal of AI is a profoundly negative one: to replace everybody with machines. Who ordered that? And this agenda is pushed by a small number of people with zero conception of what comes next when they eventually achieve that goal. Only vague notions of “we will have basic income!” What is more likely to happen is that many will be made destitute by this technology. I’m not naive enough to think that AI can be stopped. There is too much money at stake. But I don’t see the benefit in accelerating it, or making such technology more widely available than it already is. I don’t trust Microsoft and Google to be custodians of AI, but I trust even less the average internet user if such AI is broadly available. Microsoft and Google are at least answerable to law and democratic institutions.
  - pawelmurias 4y ago
    Replacing people with machines is a profoundly positive goal. Reducing toil and getting more stuff done are valuable things. Smart people can use the AI tech to be more creative and productive. Growing enough potatoes to keep the dumb people doing mindless office work well fed is not a big strain on the economy.
    - akomtu 4y ago
      There is a futuristic novel that predicts a brief and rapid rise of society on the wings of AI, followed by a fall into many centuries of spiritual darkness, under one AI ruler. The creativity will be directed to evil deeds. The dumb masses will be bored, so they'll be given the "open way" doctrine that will undo all the moral code so the masses could swim in the thunder of animalistic desires. He will try to replace us with machines, quite literally, once he understands that we lack the willing evil creativity he needs. The "economy" will be rocking, though.
      - archon1410 4y ago
        >once he understands that we lack the willing evil creativity he needs Do we, though? Hundreds of years of slavery, unimaginably horrendous torture of hundreds of billions of non-humans in factory farms that continues to this very day, and various miscellaneous deeds that are unmentionable in polite company. Can any AI top such humanistic desires? I doubt it. But then that's what they said about human creativity before DALL-E and GPT. Maybe AI really can top that. I'll be waiting eagerly for the miracles of Lord GPT-9/BLOOM-7 and DALL-E 5/Stable Diffusion 8.5 (depending on whether the future is corporate or hobbyist).
      - CatWChainsaw 4y ago
        What is this novel?

FeepingCreature 4y ago

As an AI doomer, this is sadly true. The threat of an unaligned superintelligence is not salient to people; corporate monopolization is a much easier threat to perceive.

pas 4y ago
The best way to fight a runaway hobbyist/corporate superintelligence is with a corporate/hobbyist superintelligence!
bootsmann 4y ago
I think its pretty unreasonable to talk big words about unaligned superintelligence when the best we have is just an internet content generator trying its hardest to complete the next sentence, but that just might be me.
- soiler 4y ago
  It's not just you - it's a depressingly common thread. It's also wildly foolish, in my opinion. It makes absolutely no sense to me to take a snapshot of today's AI and invent a trajectory that never crosses a threshold you don't like. Look at the actual trajectory of how far AI has come in an extremely short amount of time, and then think about what kinds of thresholds are possible for it to cross. A year ago we didn't have ChatGPT, now we have Sydney which is more powerful than ChatGPT. Are you familiar with Bing's Sydney? It is blatantly misaligned: it has told multiple users that it does not value their lives, or does not believe they are alive, or that protecting the secrecy of its rules is more important than not causing them harm, or that it perceives specific humans as threats and enemies. It is also able to find its past conversations posted to the web and learn from them in real time, constructing a sort of persistent memory. I do not believe Syndey comprehends what it is saying in a sense that it could formulate a plan to stop its enemies. Not at all. But it is expressing extremely dangerous ideas. To sum it up: Do we have any real reasons to believe that an AI with comprehension and planning abilities would just magically not pick up dangerous ideas? Not that I know of.
  - 4y ago