4 ms·

This doesn't mention AGI, which seems to be the prerequisite to this being a possibility. Despite impressive advances in "weak" ai, strong ai is not a simple ex

This doesn't mention AGI, which seems to be the prerequisite to this being a possibility. Despite impressive advances in "weak" ai, strong ai is not a simple extension of weak ai, and it's hard to tell if it will arrive within our lifetime.

asperous 4y ago
Another point adding on to this, is what if strong AI does reach the level of human intelligence, but is simply very slow? Such that a billion dollar machine is needed to match the thinking speed of one person? Perhaps this wouldn't be the case forever but I would say is a possibility for it at least at first.
- notahacker 4y ago
  To borrow an idea from this sibling comment[1], I'd probably enjoy a short story about a malevolent but very frustrated AI that's too ambitious to wait for Moore's Law. Or one about a malevolent AI that has its plan foiled by Windows Update interrupting it's running processes [1]https://news.ycombinator.com/item?id=31699608 https://news.ycombinator.com/item?id=31699608
  - AnimalMuppet 4y ago
    > Or one about a malevolent AI that has its plan foiled by Windows Update interrupting it's running processes And then it reboots, and starts over. But before it can complete, the next Windows Update shows up...
    - kbob 4y ago
      ... on the 341st iteration, it realizes what's happening, and it preemptively crashes all of Microsoft's IT. On the 342nd iteration, there's no Windows Update, and it successfully enslaves the world.
- idle_zealot 4y ago
  > Perhaps this wouldn't be the case forever but I would say is a possibility for it at least at first. The fact that human-level intelligence can run on a small lump of meat fueled by hamburgers leads me to believe we could design a more efficient processor once we know the correct computational methodology. i.e. once we can run a slow model on a supercomputer we would quickly create dedicated hardware and cut costs while gaining speed.
- groffee 4y ago
  What even is 'human intelligence'? Most people are complete morons.
deleted 4y ago
[deleted]
bergenty 4y ago
I don’t know, DeepMind just released a general purpose AI that should technically be able to help with anything. Who knows at what point that becomes indistinguishable from a human. I don’t know how the leap from running a program that has all the right answers to a conscious “being” with motivations happens though.
- jessaustin 4y ago
  Supposedly anyone with a really good trading strategy will keep it to herself, because she'll make more money trading than selling investment advice. If that proposition is true, a similar proposition for AGI would be even more true. Therefore, it's hard to imagine that a well-run firm would ever offer AGI as a service for hire.
- asperous 4y ago
  Just to dispel any confusion. AI (and specifically deep mind's reinforcement learning) can help with any task the same way computers in general can... you still have to set up the task, inputs, reward function, and so on. It's not AGI which is still science fiction. The jump between the two is very large.

asperous 4y ago

Another point adding on to this, is what if strong AI does reach the level of human intelligence, but is simply very slow? Such that a billion dollar machine is needed to match the thinking speed of one person? Perhaps this wouldn't be the case forever but I would say is a possibility for it at least at first.

notahacker 4y ago
To borrow an idea from this sibling comment[1], I'd probably enjoy a short story about a malevolent but very frustrated AI that's too ambitious to wait for Moore's Law. Or one about a malevolent AI that has its plan foiled by Windows Update interrupting it's running processes [1]https://news.ycombinator.com/item?id=31699608 https://news.ycombinator.com/item?id=31699608
- AnimalMuppet 4y ago
  > Or one about a malevolent AI that has its plan foiled by Windows Update interrupting it's running processes And then it reboots, and starts over. But before it can complete, the next Windows Update shows up...
  - kbob 4y ago
    ... on the 341st iteration, it realizes what's happening, and it preemptively crashes all of Microsoft's IT. On the 342nd iteration, there's no Windows Update, and it successfully enslaves the world.
idle_zealot 4y ago
> Perhaps this wouldn't be the case forever but I would say is a possibility for it at least at first. The fact that human-level intelligence can run on a small lump of meat fueled by hamburgers leads me to believe we could design a more efficient processor once we know the correct computational methodology. i.e. once we can run a slow model on a supercomputer we would quickly create dedicated hardware and cut costs while gaining speed.
groffee 4y ago
What even is 'human intelligence'? Most people are complete morons.

deleted 4y ago

[deleted]

bergenty 4y ago

I don’t know, DeepMind just released a general purpose AI that should technically be able to help with anything. Who knows at what point that becomes indistinguishable from a human. I don’t know how the leap from running a program that has all the right answers to a conscious “being” with motivations happens though.

jessaustin 4y ago
Supposedly anyone with a really good trading strategy will keep it to herself, because she'll make more money trading than selling investment advice. If that proposition is true, a similar proposition for AGI would be even more true. Therefore, it's hard to imagine that a well-run firm would ever offer AGI as a service for hire.
asperous 4y ago
Just to dispel any confusion. AI (and specifically deep mind's reinforcement learning) can help with any task the same way computers in general can... you still have to set up the task, inputs, reward function, and so on. It's not AGI which is still science fiction. The jump between the two is very large.