4 ms·

Glorified statistics at this point. It's very far away from any superintelligent AI.

russdill 7y ago
It's pretty neat to watch it grow. grover-mega is pretty good at grade school reading comprehension tests for instance, and it wasn't even trained on them. I gave it this test: https://www.k5learning.com/reading-comprehension-worksheets/third-grade-3/stories-kids-fables/anne-and-frank https://www.k5learning.com/reading-comprehension-worksheets/... A few caveats. I had to prompt a little extra on the 2nd question and give it a 'Because' to start off. It kept wanting to fill underscores as if it was a blank spot for an answer. There's a way to prevent this if I had time. The third question is "wrong". The actual answer is 'It would have become dark and cold if Ann and Frank had stayed later.', but I'd argue that it's rather open ended question and the answer is something that might have happened. The final question is really what makes this a 3rd grade comprehension test, it's asking the reader infer something not actually in the story, about how they would feel if they were Rover, something the AI is woefully unqualified for. Question: What did Rover fetch in the water? Answer: The Stick! Question: Why couldn’t Rover catch the rabbit? Answer: Because the rabbit ran so fast he could not catch it. Question: What might have happened if Ann and Frank stayed later? Answer: Rover could have learned that not all rabbits love to play with sticks. Question: How do you think Rover felt about not catching the rabbit? Answer: He was sore and he must have had fun later because he went in the back yard and hid out in the trees.
Tenoke 7y ago
You can describe human intelligence as 'glorified statistics', too..
- tschellenbach 7y ago
  See how good an adult is at chess after 10 games, compare that to a supercomputer AI trained on 10 games.
  - Tenoke 7y ago
    This is completely beside the point, but I'm guessing an adult who has never encountered chess but has played other games will be way worse after 10 games than an AI pre-trained on other games and then trained on 10 chess matches.

It's pretty neat to watch it grow. grover-mega is pretty good at grade school reading comprehension tests for instance, and it wasn't even trained on them. I gave it this test: https://www.k5learning.com/reading-comprehension-worksheets/third-grade-3/stories-kids-fables/anne-and-frank https://www.k5learning.com/reading-comprehension-worksheets/... A few caveats. I had to prompt a little extra on the 2nd question and give it a 'Because' to start off. It kept wanting to fill underscores as if it was a blank spot for an answer. There's a way to prevent this if I had time. The third question is "wrong". The actual answer is 'It would have become dark and cold if Ann and Frank had stayed later.', but I'd argue that it's rather open ended question and the answer is something that might have happened. The final question is really what makes this a 3rd grade comprehension test, it's asking the reader infer something not actually in the story, about how they would feel if they were Rover, something the AI is woefully unqualified for. Question: What did Rover fetch in the water? Answer: The Stick! Question: Why couldn’t Rover catch the rabbit? Answer: Because the rabbit ran so fast he could not catch it. Question: What might have happened if Ann and Frank stayed later? Answer: Rover could have learned that not all rabbits love to play with sticks. Question: How do you think Rover felt about not catching the rabbit? Answer: He was sore and he must have had fun later because he went in the back yard and hid out in the trees.

Tenoke 7y ago

You can describe human intelligence as 'glorified statistics', too..

tschellenbach 7y ago
See how good an adult is at chess after 10 games, compare that to a supercomputer AI trained on 10 games.
- Tenoke 7y ago
  This is completely beside the point, but I'm guessing an adult who has never encountered chess but has played other games will be way worse after 10 games than an AI pre-trained on other games and then trained on 10 chess matches.