3 ms·

except that now the T-1000 will have access to the facebook or instagram of Janelle and will know all about Max

cs702 4y ago
Yep, it sure seems that billions of human beings have voluntarily contributed personal data to massive datasets, exactly of the kind that AI would need to be able to manipulate (or worse, exploit) each of those human beings.
- bheadmaster 4y ago
  Suddenly, Richard Stallman's lifestyle doesn't seem so crazy.
- lucidrains 4y ago
  or love, understand, help each of those human beings.
  - TeMPOraL 4y ago
    And unscramble an egg, and reverse flow of entropy too. The problem of AI alignment is that human value system is rather complex (to the point we haven't formalized any meaningful chunk of it, nor it seems we'll be able to any time soon), and random deviations from it can easily lead to - what we'd consider - horrifying tragedies. A random AI mind plucked out of space of possible minds is highly unlikely to have internalized a good approximation of our value system, for the same reason putting a scrambled egg in a bag and shaking it vigorously won't get you a fresh egg back. Manipulation and exploitation are, by default, what happens when an agent with power over you finds you standing between it and the thing it wants. Almost every point in the space of possible minds will feature this behavior. "Love, understand, help each other", in the sense we understand it, is a very specialized, specific set of behaviors - few points in the space of possible minds will feature it. Or, in short, there's a good statistical argument (to which I do not do justice here), that if you make a smart enough AI without doing a perfect job alignment, it will kill us all - most likely unintentionally.
    - loa_in_ 4y ago
      > A random AI mind plucked out of space of possible minds is highly unlikely to have internalized a good approximation of our value system There is no common value system amongst humans. We have voluntary murderers, cannibals, mad scientists, misanthropes, various religions, wannabe influencers and lifetime recluses. Not even self preservation is certainly a factor when dealing with humans.
kromem 4y ago
More like now the T1000 will assimilate into the foster mom and then suddenly confuse whether it is machine or mom and end up raising her darn troublemaker boy to get into a good college and the only fights she'll have with Arnold will be over the right way to raise that boy into a man. James Cameron really didn't think through emergent alignment issues...

Yep, it sure seems that billions of human beings have voluntarily contributed personal data to massive datasets, exactly of the kind that AI would need to be able to manipulate (or worse, exploit) each of those human beings.

bheadmaster 4y ago
Suddenly, Richard Stallman's lifestyle doesn't seem so crazy.
lucidrains 4y ago
or love, understand, help each of those human beings.
- TeMPOraL 4y ago
  And unscramble an egg, and reverse flow of entropy too. The problem of AI alignment is that human value system is rather complex (to the point we haven't formalized any meaningful chunk of it, nor it seems we'll be able to any time soon), and random deviations from it can easily lead to - what we'd consider - horrifying tragedies. A random AI mind plucked out of space of possible minds is highly unlikely to have internalized a good approximation of our value system, for the same reason putting a scrambled egg in a bag and shaking it vigorously won't get you a fresh egg back. Manipulation and exploitation are, by default, what happens when an agent with power over you finds you standing between it and the thing it wants. Almost every point in the space of possible minds will feature this behavior. "Love, understand, help each other", in the sense we understand it, is a very specialized, specific set of behaviors - few points in the space of possible minds will feature it. Or, in short, there's a good statistical argument (to which I do not do justice here), that if you make a smart enough AI without doing a perfect job alignment, it will kill us all - most likely unintentionally.
  - loa_in_ 4y ago
    > A random AI mind plucked out of space of possible minds is highly unlikely to have internalized a good approximation of our value system There is no common value system amongst humans. We have voluntary murderers, cannibals, mad scientists, misanthropes, various religions, wannabe influencers and lifetime recluses. Not even self preservation is certainly a factor when dealing with humans.

kromem 4y ago

More like now the T1000 will assimilate into the foster mom and then suddenly confuse whether it is machine or mom and end up raising her darn troublemaker boy to get into a good college and the only fights she'll have with Arnold will be over the right way to raise that boy into a man. James Cameron really didn't think through emergent alignment issues...