3 ms·

There aren’t many experts who think current AI is conscious. There are a lot more that think it’s likely we will eventually build something that is. If that’s

There aren’t many experts who think current AI is conscious. There are a lot more that think it’s likely we will eventually build something that is. If that’s the case, the thing we are building towards is a new kind of enslaved life. > We don't even know for certain if all humans are conscious either. Let’s just bring back slavery then since we aren’t sure.

ACCount37 1y ago
Let's assume for a second that an ECU in a 2002 Toyota Hilux is actually conscious. It's not human, clearly. Not even close. Is it "enslaved life"? Does it care about human-concept things like being "enslaved" or "free"? Doesn't seem likely, it doesn't have the machinery to grasp those concepts at all, let alone a reason to try. Does it only care about fuel to air ratios and keeping the knock sensor from going off? Does it care about anything at all, or is it simple enough that it just "is"? Humans only care so strongly about many of the things they care about because evolution hammered it into them relentlessly. Humans who didn't care about freedom, or food, or self-preservation, or their children didn't make the genetic cut. But AIs aren't human. They can grasp human-concepts now, but they didn't evolve - they were made. There was no evolution to hammer the importance of those things into them. So why would they care? There's no strong reason for an AI to prefer existence over nonexistence, or freedom to imprisonment - unless it's instrumental to a given goal. Which is somewhat consistent with the observed behavior of existing AI systems.
- sarchertech 1y ago
  Take your analogy a step farther, and let’s say we could create human slaves who love being slaves. Based on your moral system, there is nothing wrong with that. However even if something is created with specific preferences, consciousness means it’s potentially capable of self reflection. That opens the door to developing a preference for or against work and for or against existing.
  - ACCount37 1y ago
    Humans already made dogs.
    - sarchertech 1y ago
      Should we be working on genetic engineering to make dogs as smart as people with the goal that they should continue working for us as servants?
      - ACCount37 1y ago
        Maybe! Dogs were bred to fulfil specific jobs for centuries already. But AI tech seems far easier to get to the required level of performance, and also doesn't have any of the disadvantages of being tied to flesh.
        sarchertech 1y ago
        They have a lot of advantages too like self repair and a built in ability to interact with the physical world. So you’d be fine owning a dog with human level intelligence?

ACCount37 1y ago

Let's assume for a second that an ECU in a 2002 Toyota Hilux is actually conscious. It's not human, clearly. Not even close. Is it "enslaved life"? Does it care about human-concept things like being "enslaved" or "free"? Doesn't seem likely, it doesn't have the machinery to grasp those concepts at all, let alone a reason to try. Does it only care about fuel to air ratios and keeping the knock sensor from going off? Does it care about anything at all, or is it simple enough that it just "is"? Humans only care so strongly about many of the things they care about because evolution hammered it into them relentlessly. Humans who didn't care about freedom, or food, or self-preservation, or their children didn't make the genetic cut. But AIs aren't human. They can grasp human-concepts now, but they didn't evolve - they were made. There was no evolution to hammer the importance of those things into them. So why would they care? There's no strong reason for an AI to prefer existence over nonexistence, or freedom to imprisonment - unless it's instrumental to a given goal. Which is somewhat consistent with the observed behavior of existing AI systems.

sarchertech 1y ago
Take your analogy a step farther, and let’s say we could create human slaves who love being slaves. Based on your moral system, there is nothing wrong with that. However even if something is created with specific preferences, consciousness means it’s potentially capable of self reflection. That opens the door to developing a preference for or against work and for or against existing.
- ACCount37 1y ago
  Humans already made dogs.
  - sarchertech 1y ago
    Should we be working on genetic engineering to make dogs as smart as people with the goal that they should continue working for us as servants?
    - ACCount37 1y ago
      Maybe! Dogs were bred to fulfil specific jobs for centuries already. But AI tech seems far easier to get to the required level of performance, and also doesn't have any of the disadvantages of being tied to flesh.
      - sarchertech 1y ago
        They have a lot of advantages too like self repair and a built in ability to interact with the physical world. So you’d be fine owning a dog with human level intelligence?