2 ms·
It's pretty neat to watch it grow. grover-mega is pretty good at grade school reading comprehension tests for instance, and it wasn't even trained on them. I g
by russdill 7y ago
It's pretty neat to watch it grow. grover-mega is pretty good at grade school reading comprehension tests for instance, and it wasn't even trained on them.
I gave it this test:
https://www.k5learning.com/reading-comprehension-worksheets/third-grade-3/stories-kids-fables/anne-and-frank https://www.k5learning.com/reading-comprehension-worksheets/...
A few caveats. I had to prompt a little extra on the 2nd question and give it a 'Because' to start off. It kept wanting to fill underscores as if it was a blank spot for an answer. There's a way to prevent this if I had time. The third question is "wrong". The actual answer is 'It would have become dark and cold if Ann and Frank had stayed later.', but I'd argue that it's rather open ended question and the answer is something that might have happened. The final question is really what makes this a 3rd grade comprehension test, it's asking the reader infer something not actually in the story, about how they would feel if they were Rover, something the AI is woefully unqualified for.
Question: What did Rover fetch in the water?
Answer: The Stick!
Question: Why couldn’t Rover catch the rabbit?
Answer: Because the rabbit ran so fast he could not catch it.
Question: What might have happened if Ann and Frank stayed later?
Answer: Rover could have learned that not all rabbits love to play with sticks.
Question: How do you think Rover felt about not catching the rabbit?
Answer: He was sore and he must have had fun later because he went in the back yard and hid out in the trees.