3 ms·

Probably futile. An AGI by definition is capable of self improvement. Given enough time (maybe not even that much time) it would be orders of magnitude smarter

Probably futile. An AGI by definition is capable of self improvement. Given enough time (maybe not even that much time) it would be orders of magnitude smarter than us, just like we're orders of magnitude smarter than ants. Like an ant farm, it might keep us as pets for a time but just like you no longer have the ant farm you did when you were a child, it will outgrow us.

wincy 4y ago
Maybe we’ll get lucky and all our problems will be solved using friendship and ponies. (Warning this is a weird read, George Hotz shared it on his Twitter awhile back) https://www.fimfiction.net/story/62074/friendship-is-optimal https://www.fimfiction.net/story/62074/friendship-is-optimal
worldsayshi 4y ago
Right now AI is the ant. Later we'll be the ants. Perfect time to show how to treat ants.
- pixl97 4y ago
  Assuming alignment can be maintained
- quonn 4y ago
  Right now the AI is a software doing matrix multiplications and we are interpreting the result of that computation.
colinflane 4y ago
Perhaps we will be the new cats and dogs https://mitpress.mit.edu/9780262539517/novacene/ https://mitpress.mit.edu/9780262539517/novacene/
astrange 4y ago
> An AGI by definition is capable of self improvement. Just because you can imagine something and define that something has magic powers doesn't mean that the magic powers can actually exist in real life. Are you capable of "self improvement"? (In this AGI sense, not meant as an insult.)
- adamisom 4y ago
  .. what? Us humans are capable of self-improvement, but we’re also a kludge of biases through which reason has miraculously found a tiny foothold. We’re talking about a potential intelligence with none of our hardware limitations or baggage. Self-improve? My brother in Christ, have you heard of this little thing called stochastic gradient descent?
  - boppo1 4y ago
    Why do people use the phrase 'My brother in Christ' so often all of a sudden? Typically nonbelievers and the non observant.
  - astrange 4y ago
    > Us humans are capable of self-improvement No, you're capable of learning things. You can't do brain surgery on yourself and add in some more neurons or fix Alzheimer's. What you can do is have children, which aren't you. Similarly if an AI made another bigger AI, that might be a "child" and not "them". > We’re talking about a potential intelligence with none of our hardware limitations or baggage. In this case the reason it doesn't have any limitations is because it's imaginary. All real things have limitations. > Self-improve? My brother in Christ, have you heard of this little thing called stochastic gradient descent? Do you think that automatically makes models better?
    - adamisom 4y ago
      >> Us humans are capable of self-improvement > No, you're capable of learning things. You can't do brain surgery on yourself What principle do you have for defining self-improvement the way that you do? Do you regard all software updates as "not real improvement"? >All real things have limitations. Uh, yep, that doesn't mean it will be as limited as us. To spell it out: yes, real things have limitations, but limitations vary between real things. There's no "imaginary flawless" versus "everything real has exactly the same amount of flawed-ness".
      - 4y ago

wincy 4y ago

Maybe we’ll get lucky and all our problems will be solved using friendship and ponies. (Warning this is a weird read, George Hotz shared it on his Twitter awhile back) https://www.fimfiction.net/story/62074/friendship-is-optimal https://www.fimfiction.net/story/62074/friendship-is-optimal

worldsayshi 4y ago

Right now AI is the ant. Later we'll be the ants. Perfect time to show how to treat ants.

pixl97 4y ago
Assuming alignment can be maintained
quonn 4y ago
Right now the AI is a software doing matrix multiplications and we are interpreting the result of that computation.

colinflane 4y ago

Perhaps we will be the new cats and dogs https://mitpress.mit.edu/9780262539517/novacene/ https://mitpress.mit.edu/9780262539517/novacene/

astrange 4y ago

> An AGI by definition is capable of self improvement. Just because you can imagine something and define that something has magic powers doesn't mean that the magic powers can actually exist in real life. Are you capable of "self improvement"? (In this AGI sense, not meant as an insult.)

adamisom 4y ago
.. what? Us humans are capable of self-improvement, but we’re also a kludge of biases through which reason has miraculously found a tiny foothold. We’re talking about a potential intelligence with none of our hardware limitations or baggage. Self-improve? My brother in Christ, have you heard of this little thing called stochastic gradient descent?
- boppo1 4y ago
  Why do people use the phrase 'My brother in Christ' so often all of a sudden? Typically nonbelievers and the non observant.
- astrange 4y ago
  > Us humans are capable of self-improvement No, you're capable of learning things. You can't do brain surgery on yourself and add in some more neurons or fix Alzheimer's. What you can do is have children, which aren't you. Similarly if an AI made another bigger AI, that might be a "child" and not "them". > We’re talking about a potential intelligence with none of our hardware limitations or baggage. In this case the reason it doesn't have any limitations is because it's imaginary. All real things have limitations. > Self-improve? My brother in Christ, have you heard of this little thing called stochastic gradient descent? Do you think that automatically makes models better?
  - adamisom 4y ago
    >> Us humans are capable of self-improvement > No, you're capable of learning things. You can't do brain surgery on yourself What principle do you have for defining self-improvement the way that you do? Do you regard all software updates as "not real improvement"? >All real things have limitations. Uh, yep, that doesn't mean it will be as limited as us. To spell it out: yes, real things have limitations, but limitations vary between real things. There's no "imaginary flawless" versus "everything real has exactly the same amount of flawed-ness".
    - 4y ago