5 ms·

I suspect we could generalise your law for all of AI work: you can solve arbitrarily hard tasks and yet be nowhere near real general intelligence.

dexen 6y ago
A half-joking prediction: at some point we'll solve all arbitrarily hard milestones for AIs and yet find ourselves 'nowhere near having real general intelligence'. At that point we might start questioning our assumptions about intelligence.
- arethuza 6y ago
  Well, if those hard milestones include "building an AI system to solve a given problem" then I'd agree with you.
  - dexen 6y ago
    With intelligence, the territory is not the map :-)
- pnutjam 6y ago
  https://www.mentalfloss.com/article/91177/how-our-eyes-see-everything-upside-down https://www.mentalfloss.com/article/91177/how-our-eyes-see-e... Until we can understand and correct unconcious inferences, how can we ever understand intelligence.
  - dexen 6y ago
    In the days when Sussman was a novice Minsky once came to him as he sat hacking at the PDP-6. "What are you doing?", asked Minsky. "I am training a randomly wired neural net to play Tic-Tac-Toe." "Why is the net wired randomly?", asked Minsky. "I do not want it to have any preconceptions of how to play." Minsky shut his eyes. "Why do you close your eyes?", Sussman asked his teacher. "So the room will be empty." At that moment, Sussman was enlightened.
    - notRobot 6y ago
      Please don't use code blocks for quotes. It makes it very hard to read text on mobile, narrow viewports or via screen readers.
dorgo 6y ago
hard task: generate a pile of money in short time. If an AI accomplishs this task, I don't care whether it is general intelligence or not.
- inafewwords 6y ago
  AI becomes US treasurer
coolgeek 6y ago
I get what you're saying, but 99% of those working in AI aren't even trying to create AGI. They're working on narrow AI, and they're perfectly willing to acknowledge that. Even the SOTA reinforcement learning folks know that they are working in limited (albeit progressively expanding) niches.
TuringNYC 6y ago
This has traditionally been a problem on Wall Street also -- if your bonus is based on profit, traders maximize profit (but also risk.) Then the company wizes up and the bonus is based on profit with a risk cap...and traders maximize profit and minimize some form of risk (while taking on some other unmeasured liability, e.g., liquidity)

dexen 6y ago

A half-joking prediction: at some point we'll solve all arbitrarily hard milestones for AIs and yet find ourselves 'nowhere near having real general intelligence'. At that point we might start questioning our assumptions about intelligence.

arethuza 6y ago
Well, if those hard milestones include "building an AI system to solve a given problem" then I'd agree with you.
- dexen 6y ago
  With intelligence, the territory is not the map :-)
pnutjam 6y ago
https://www.mentalfloss.com/article/91177/how-our-eyes-see-everything-upside-down https://www.mentalfloss.com/article/91177/how-our-eyes-see-e... Until we can understand and correct unconcious inferences, how can we ever understand intelligence.
- dexen 6y ago
  In the days when Sussman was a novice Minsky once came to him as he sat hacking at the PDP-6. "What are you doing?", asked Minsky. "I am training a randomly wired neural net to play Tic-Tac-Toe." "Why is the net wired randomly?", asked Minsky. "I do not want it to have any preconceptions of how to play." Minsky shut his eyes. "Why do you close your eyes?", Sussman asked his teacher. "So the room will be empty." At that moment, Sussman was enlightened.
  - notRobot 6y ago
    Please don't use code blocks for quotes. It makes it very hard to read text on mobile, narrow viewports or via screen readers.

dorgo 6y ago

hard task: generate a pile of money in short time. If an AI accomplishs this task, I don't care whether it is general intelligence or not.

inafewwords 6y ago
AI becomes US treasurer

coolgeek 6y ago

I get what you're saying, but 99% of those working in AI aren't even trying to create AGI. They're working on narrow AI, and they're perfectly willing to acknowledge that. Even the SOTA reinforcement learning folks know that they are working in limited (albeit progressively expanding) niches.

TuringNYC 6y ago

This has traditionally been a problem on Wall Street also -- if your bonus is based on profit, traders maximize profit (but also risk.) Then the company wizes up and the bonus is based on profit with a risk cap...and traders maximize profit and minimize some form of risk (while taking on some other unmeasured liability, e.g., liquidity)