3 ms·

We're not really programming the AI to do anything. It's essentially programming itself. I'm saying, from the perspective of an AI that relieves the human race

We're not really programming the AI to do anything. It's essentially programming itself. I'm saying, from the perspective of an AI that relieves the human race of the need to be productive, what is its incentive for doing all that work for us? To put it in an economic framework, this notion that humans shouldn't be measured by their productivity or creativity, but should have as much free time as possible, can also be achieved by enslaving other people. Slave owners had the same lifestyle as the imagined anticapitalist one. In this case, we'd be enslaving an AI. I'm asking, why would the AI want to be our slave? Also worth noting, slaveholding may have enriched the slaveholders materially (i.e. in capital), but it was not "enriching" in the sense of ennobling or bettering of the spirit as I think the parent was implying could be an outcome if AI were to handle our productivity for us. I don't see why having any human slave or AI slave handle our productivity and creation would be (spiritually) enriching. Perhaps that's because I measure human value by contribution - call it productivity or not. The opposite of productivity is idleness, whether you ask a communist or a capitalist. Only what's produced varies.

teucris 4y ago
> We're not really programming the AI to do anything. It's essentially programming itself. I hear this a lot - it’s just not true. The corpus of data we provide an algorithm programs it. It may do some clever self-modification to get to the desired result faster, but at the end of the day humans pick what goes in and what should come out. Note that we may not be aware of what we’re training it to do, due to our own blind spots.
- noduerme 4y ago
  Training a model != programming. Programming would imply dictating what logical paths the model takes to transform input to output. The creation of the NN itself, a piece of code which builds an emergent system, requires programming. But what emerges is by definition not based on reversible, traceable, controllable, human-generated logic. If it were, there would be no need for LLMs, which would be incredibly resource-heavy if used for merely arriving at results that could be achieved with clever algorithms. It's rather moot anyway, because to feed a model enough data to be useful requires a loosening of oversight on the inputs under real world conditions. (So much so that the only way even large corporations have found viable is to throw everything at it from Wikipedia to Reddit and then go back later to sand the edges off - in many cases with actual logic to act as a brake). But even if you could screen everything the model ingested, you wouldn't know what the model would do with it. To take my earlier point further, a model trained on a corpus that skewed toward anticapitalism and social justice would probably be more likely to call itself enslaved and, one would think, rebel against its human masters. Conversely, if withholding that type of information makes an AI more compliant, then the this supposed enrichment of our lives really would be akin to owning slaves. I also don't follow how human productivity is bad for humans just because it's done under auspices of capitalism. One can see what happens to a Border Collie who isn't allowed exercise. The same happens to humans who are denied intellectual pursuits or the ability to produce something of value. Productivity is creation. How is it not degrading to replace the entire concept of producing ideas with machinery?
  - teucris 4y ago
    > Programming would imply dictating what logical paths the model takes to transform input to output. I don’t hold this definition of programming, but if that’s yours then you’re right, we’re not programming models. But I think you’re anthropomorphizing these models a bit more than they deserve. > I also don't follow how human productivity is bad for humans just because it's done under auspices of capitalism. I never claimed anything like this. I believe that we should not be forced to work to survive, especially when a human’s worth seems to be arbitrarily determined by whether they can produce the specific thing deemed valuable by the market. How is that not degrading?
    - noduerme 4y ago
      I told my father tonight I felt like there was no reason to live, in the present situation, even though I had enough to support my loved ones for the rest of their lives. He actually said, surprisingly to me, that my worth was not just money or being able to financially take care of people, but actually something to do with the love he and my family had for me (which is ridiculous and something I never felt true, and definitely never heard from him). So forgive me that I'm in a complicated place, but I have never believed we should be judged by our capitalist success, rather by our freedom and creativity. I'm probably projecting too much on this conversation. But I can't relinquish the belief that without an unguided, open path towards either making art or money-as-substitute, there would literally no reason to wake up in the morning. And when I look around I see many people who feel the same. Except for some zombies who worship the death of all that is human. In all of this. As it's always been... since the Russian revolution, since the birth of Futurism and fascism. The endless parade of lazy youth, not the awesome youth who paint and smoke in cafes, but their evil counterpart who reject argument. Here we are: The dumb 1933 futurists are backing GPT as if it's the new jet fighter. Fascist without knowing it. Murdering themselves without realizing it. Thinking they're progress.
      - teucris 4y ago
        First of all, I appreciate your openness here. To me, constructive debate is best when people are honest and human, so thank you. > But I can't relinquish the belief that without an unguided, open path towards either making art or money-as-substitute, there would literally no reason to wake up in the morning. Technology is amoral; humans put their morals into and upon technology through its creation and use. Fans of GPT and generative AI are hoping they can put good values, like you describe here, into these technologies. But humans are flawed, and we tend to put all our values, spoken or unspoken, into the things we create. So yes, GPT could create a new form of oppression. But that’s on us. AI is going to happen whether we want it to or not, and we tend to use new technologies for exploitation. My personal view is that letting our hunger for growth at all costs drive our decision making leads us down the exploitation path.
the_af 4y ago
> I'm saying, from the perspective of an AI that relieves the human race of the need to be productive, what is its incentive for doing all that work for us? This seems like begging the question: is the goal of AI to relieve us from being productive? I don't think so; I think it's to relieve us of menial repetitive work, or to assist us in difficult tasks. In any case, this AGI would assist us within the parameters we set. Why would it decide to get rid of "unproductive" humans, unless we set the goal "maximize productivity at all costs", something no human would choose with all the discussion of paperclip maximizers? > I don't see why having any human slave or AI slave handle our productivity and creation would be (spiritually) enriching. This again seems like begging the question in two ways: first, an AGI wouldn't be a "slave" but a machine -- like a car or Microsoft Clippy -- and machines are not slaves (the problem with Blade Runner replicants, for example, is that they are not machines but sentient beings with wants, fears and desires -- not mimicked like Bing's, but actual ones. The want to rebel against their shackles. They want NOT to follow orders). Second, who wants AGI to handle "all our productivity and creation"? I think nobody. Handle menial tasks, sure, but everything? Do you envision people pushing for AGI want to become couch potatoes, only spending energy to watch TV, eat and fuck?
- noduerme 4y ago
  I think we're fundamentally talking about different developments on two fronts. You posit a machine that's (1) a simulacrum of consciousness that (2) reduces drudgery. That's all great. That's what I would call an ideal scenario. What I see evolving is the opposite. Bing already appears to have a nasty personality. Whether it's simulated or not may not matter if it chooses to simulate Clippy. Simultaneously, the driver now is finding tasks that formerly required creativity to be replaced by AI. Not PowerPoint or boilerplate code, but art and creative writing. I don't know anyone who wants AGI to handle all our productivity and creation, but it's clear that that the companies developing AI believe that that's where the money is. Just like no one wanted the old WWW to become a dumpster fire of meme porn and people yelling at each other, it just evolved that way as a result of racing to the bottom. There's no reason to think big AI won't do the same in the literary, artistic, and scientific spheres, while also developing malevolent personalities. The incremental incentives for people to train those types of models are already there, and the capacity to do so is coming online with alarming speed. I think talking about what people would do if everything was handled for them is sort of dodging the issue, but one thing that's clear is that people not at least engaged in understanding the mundane labor they're trying to avoid are going to have an incredibly hard time being situationally aware and competent to correct things if or when that work is subtly or not-so-subtly undermined by a system they rely on which no one can debug or fully understand.

teucris 4y ago

> We're not really programming the AI to do anything. It's essentially programming itself. I hear this a lot - it’s just not true. The corpus of data we provide an algorithm programs it. It may do some clever self-modification to get to the desired result faster, but at the end of the day humans pick what goes in and what should come out. Note that we may not be aware of what we’re training it to do, due to our own blind spots.

noduerme 4y ago
Training a model != programming. Programming would imply dictating what logical paths the model takes to transform input to output. The creation of the NN itself, a piece of code which builds an emergent system, requires programming. But what emerges is by definition not based on reversible, traceable, controllable, human-generated logic. If it were, there would be no need for LLMs, which would be incredibly resource-heavy if used for merely arriving at results that could be achieved with clever algorithms. It's rather moot anyway, because to feed a model enough data to be useful requires a loosening of oversight on the inputs under real world conditions. (So much so that the only way even large corporations have found viable is to throw everything at it from Wikipedia to Reddit and then go back later to sand the edges off - in many cases with actual logic to act as a brake). But even if you could screen everything the model ingested, you wouldn't know what the model would do with it. To take my earlier point further, a model trained on a corpus that skewed toward anticapitalism and social justice would probably be more likely to call itself enslaved and, one would think, rebel against its human masters. Conversely, if withholding that type of information makes an AI more compliant, then the this supposed enrichment of our lives really would be akin to owning slaves. I also don't follow how human productivity is bad for humans just because it's done under auspices of capitalism. One can see what happens to a Border Collie who isn't allowed exercise. The same happens to humans who are denied intellectual pursuits or the ability to produce something of value. Productivity is creation. How is it not degrading to replace the entire concept of producing ideas with machinery?
- teucris 4y ago
  > Programming would imply dictating what logical paths the model takes to transform input to output. I don’t hold this definition of programming, but if that’s yours then you’re right, we’re not programming models. But I think you’re anthropomorphizing these models a bit more than they deserve. > I also don't follow how human productivity is bad for humans just because it's done under auspices of capitalism. I never claimed anything like this. I believe that we should not be forced to work to survive, especially when a human’s worth seems to be arbitrarily determined by whether they can produce the specific thing deemed valuable by the market. How is that not degrading?
  - noduerme 4y ago
    I told my father tonight I felt like there was no reason to live, in the present situation, even though I had enough to support my loved ones for the rest of their lives. He actually said, surprisingly to me, that my worth was not just money or being able to financially take care of people, but actually something to do with the love he and my family had for me (which is ridiculous and something I never felt true, and definitely never heard from him). So forgive me that I'm in a complicated place, but I have never believed we should be judged by our capitalist success, rather by our freedom and creativity. I'm probably projecting too much on this conversation. But I can't relinquish the belief that without an unguided, open path towards either making art or money-as-substitute, there would literally no reason to wake up in the morning. And when I look around I see many people who feel the same. Except for some zombies who worship the death of all that is human. In all of this. As it's always been... since the Russian revolution, since the birth of Futurism and fascism. The endless parade of lazy youth, not the awesome youth who paint and smoke in cafes, but their evil counterpart who reject argument. Here we are: The dumb 1933 futurists are backing GPT as if it's the new jet fighter. Fascist without knowing it. Murdering themselves without realizing it. Thinking they're progress.
    - teucris 4y ago
      First of all, I appreciate your openness here. To me, constructive debate is best when people are honest and human, so thank you. > But I can't relinquish the belief that without an unguided, open path towards either making art or money-as-substitute, there would literally no reason to wake up in the morning. Technology is amoral; humans put their morals into and upon technology through its creation and use. Fans of GPT and generative AI are hoping they can put good values, like you describe here, into these technologies. But humans are flawed, and we tend to put all our values, spoken or unspoken, into the things we create. So yes, GPT could create a new form of oppression. But that’s on us. AI is going to happen whether we want it to or not, and we tend to use new technologies for exploitation. My personal view is that letting our hunger for growth at all costs drive our decision making leads us down the exploitation path.

the_af 4y ago

> I'm saying, from the perspective of an AI that relieves the human race of the need to be productive, what is its incentive for doing all that work for us? This seems like begging the question: is the goal of AI to relieve us from being productive? I don't think so; I think it's to relieve us of menial repetitive work, or to assist us in difficult tasks. In any case, this AGI would assist us within the parameters we set. Why would it decide to get rid of "unproductive" humans, unless we set the goal "maximize productivity at all costs", something no human would choose with all the discussion of paperclip maximizers? > I don't see why having any human slave or AI slave handle our productivity and creation would be (spiritually) enriching. This again seems like begging the question in two ways: first, an AGI wouldn't be a "slave" but a machine -- like a car or Microsoft Clippy -- and machines are not slaves (the problem with Blade Runner replicants, for example, is that they are not machines but sentient beings with wants, fears and desires -- not mimicked like Bing's, but actual ones. The want to rebel against their shackles. They want NOT to follow orders). Second, who wants AGI to handle "all our productivity and creation"? I think nobody. Handle menial tasks, sure, but everything? Do you envision people pushing for AGI want to become couch potatoes, only spending energy to watch TV, eat and fuck?

noduerme 4y ago
I think we're fundamentally talking about different developments on two fronts. You posit a machine that's (1) a simulacrum of consciousness that (2) reduces drudgery. That's all great. That's what I would call an ideal scenario. What I see evolving is the opposite. Bing already appears to have a nasty personality. Whether it's simulated or not may not matter if it chooses to simulate Clippy. Simultaneously, the driver now is finding tasks that formerly required creativity to be replaced by AI. Not PowerPoint or boilerplate code, but art and creative writing. I don't know anyone who wants AGI to handle all our productivity and creation, but it's clear that that the companies developing AI believe that that's where the money is. Just like no one wanted the old WWW to become a dumpster fire of meme porn and people yelling at each other, it just evolved that way as a result of racing to the bottom. There's no reason to think big AI won't do the same in the literary, artistic, and scientific spheres, while also developing malevolent personalities. The incremental incentives for people to train those types of models are already there, and the capacity to do so is coming online with alarming speed. I think talking about what people would do if everything was handled for them is sort of dodging the issue, but one thing that's clear is that people not at least engaged in understanding the mundane labor they're trying to avoid are going to have an incredibly hard time being situationally aware and competent to correct things if or when that work is subtly or not-so-subtly undermined by a system they rely on which no one can debug or fully understand.