4 ms·

The writer's complaint is daft. The purpose is to test if you can read a passage and comprehend it. Has nothing to do with microscopes. From my understanding o

The writer's complaint is daft. The purpose is to test if you can read a passage and comprehend it. Has nothing to do with microscopes. From my understanding of cognitive science, the question asked is deeply flawed if you want to test comprehension without testing knowledge of microscopes. One approach to answering questions like this is to build a little model in your head of what is being described. You then answer questions about the model in your head. Experience with microscopes or similar devices is incredibly valuable to building such a model in your head and answering questions about it. This was one of the “big problems” in first generation AI: to answer questions, a computer must be able to construct models, and to construct models, a computer needs a huge amount of real-world experience. What I’m saying is that answering this question well requires experience with microscopes or similar devices. Being able to answer the question without prior knowledge of what a microscope is, or how light behaves, or lenses period, or refracting telescopes, and so forth, is ridiculously hard. Now, there may be a good reason why an entire test full of a variety of such questions is effective for accomplishing whatever the school board wants accomplished—getting funding, I imagine—but I stop well short of saying the author’s complaint is “daft.” I think there are good reasons to be curious about the biases inherent in this question, and about where schools end up if they build their entire approach to teaching around scoring well on questions like this.

CognitiveLens 14y ago
It is a reading comprehension question. Read the text provided: "To avoid crushing the glass slide when focusing, begin with the lens close to the specimen" The microscope lens should initially be placed close to the glass slide: C. To avoid breaking the glass slide when adjusting the focus.
- shasta 14y ago
  So wait, you're saying the reason for the lens to begin close to the glass is the same reason the lens should begin close to the specimen? How did you come to that conclusion?
  - CognitiveLens 14y ago
    Context clues from the "How to" section steps 2-6.
    - shasta 14y ago
      Or you already knew how a microscope works, and performed that step implicitly like the rest of us did.
- spamizbad 14y ago
  "The microscope lens should initially be placed close to the glass slide: C. To avoid breaking the glass slide when adjusting the focus." Incidentally that statement only sense if you know which direction to turn the focus knob, and you recognize the fact that the hypothetical microscope is capable of crushing the specimen. I had one when I was a kid that was incapable of doing so. I answered the question correctly, but it only due to my cynicism, not my reading comprehension.
  - fennecfoxen 14y ago
    Blah blah blah blah. "To avoid crushing the glass slide when focusing, begin with the microscope close to the specimen and then gradually back off to focus." Blah blah blah blah. Utterly incomprehensible!
    - fennecfoxen 14y ago
      And you know what? I'll tell you why people get this wrong. It's because their brains turn off. They say "omg microscopes scary! big block of text!" and guess at answers instead of actually bothering to try and read the text. That's one reason why they get poor scores at reading comprehension: a lack of reading with intent to comprehend. Heck, if they're pressed for time and the guessing-wrong penalty is low enough, it's an entirely rational response. The fact that the journalist is that dense is mostly a symptom of "oh hey I've found an argument against standardized testing to fit my preexisting conceptions of the matter! Screw reading it, it looks complicated, I'll just use it to justify things." Same basic problem.
      - Karunamon 14y ago
        >It's because their brains turn off. They say "omg microscopes scary! big block of text!" s/microscope/computer and you have the cause of an average Helpdesk's stress... ed. Downvotes? Really? Nobody has ever struggled with a problem which could be solved if the help-ee has bothered to read the text on their screen?
        14y ago
- raganwald 14y ago
  I saw that too. It doesn’t change the fact that understanding of the domain strongly biases the result of answering the question. What you’re saying is that it is possible to answer the question while staring bewildered at a device you have never seen or interacted with. What I’m saying is that it is much easier to answer the question if you have hands-on experience. And I think what the author is saying is that we should spend more time giving kids microscopes and testing what they see with them. TANGENT ABOUT BIKE SHED COLOURS: Questions like this remind me of questions about OOP. First the preamble: “Organize objects into classes to create a hierarchy of abstract types....” Then a question: “Classes are used to (a) provide a constructor for objects, (b) to promote reuse of behaviour, (c) to model a type hierarchy, (d) to facilitate modular software development.” You ask someone to build a model in their head, and then the most successful strategy for answering the question is to turn the model off and use brute force to scan the exact words of the question, because the more knowledge you have of the domain, the less likely you are to answer the question correctly from your experience.
  - ErrantX 14y ago
    What you’re saying is that it is possible to answer the question while staring bewildered at a device you have never seen or interacted with. Based on my life experience so far; this is one of the most important skills to learn. What I’m saying is that it is much easier to answer the question if you have hands-on experience. Of course; but that isn't the point of the test. And I think what the author is saying is that we should spend more time giving kids microscopes and testing what they see with them. Yes, but again this test is not about that. And if the author is arguing that practical experience should entirely supplant this sort of critical thinking then I entirely disagree. Critical thinking is taught from a young age, in very subtle ways. The ability to approach a topic you know nothing about, dissemble it, and answer a question (either posed to you, or by you) is fundamental to all of our lives.
    - luser001 14y ago
      off topic: i hope you meant 'disassemble' :). 'dissemble' means "to put on a false appearance : conceal facts, intentions, or feelings under some pretense" according to http://www.merriam-webster.com/dictionary/dissemble http://www.merriam-webster.com/dictionary/dissemble.
jellicle 14y ago
> One approach to answering questions like this is to build a little model This test question isn't testing that. > What I’m saying is that answering this question well requires experience with microscopes or similar devices. It sure doesn't. It requires you to be able to read and comprehend text. That's it. The subject could have been Martian fizzbozzles instead of microscopes. > Being able to answer the question without prior knowledge of what a microscope is, or how light behaves, or lenses period, or refracting telescopes, and so forth, is ridiculously hard. It sure isn't. Anyone who can read and comprehend text can answer it with no prior knowledge of the subject.
- raganwald 14y ago
  My HN friend, my argument was that the writer isn’t daft, and neither is his complaint, and I stand by that. My argument is that the writer raises interesting and useful questions, and I stand by that too. As to the fact that the question doesn’t test internal modelling, of course it does. If you made it a question about something nobody has ever seen before, then it wouldn’t test knowledge of microscopes. But it does ask about microscopes. Perhaps, in aggregate, the test covers enough subject areas that the students tested will be exposed to a roughly equal mix of things they have experience with and things they don’t. But as I noted elsewhere, the fact that it’s possible to answer this question from the text alone in no way changes the fact that it’s easier to answer the question with prior experience. And from that, I think it’s perfectly reasonable to ask whether this is a good question.
  - calibraxis 14y ago
    Yes, if it were truly just about reading comprehension, then the test-writers would be horrifically incompetent, and therefore unfit to test anyone. Anyone who competently designs tests (experimenters, pollsters, etc) knows to address such biasing factors. But I think the testers aren't total morons, and know that such a question is biased towards children with proper (privileged) backgrounds where microscopes and the respective training are commonplace. They'll be faster at answering the question and not feel ignorant — crucial advantages on tests. (The testers may not even like this facet of their jobs, like ad industry developers who use ad-blockers, but it sure beats unemployment.) And the whole question smacks of "scientism", where tools are confused with science. You never see a question like, "Scientists have believed something for 200 years. Is it necessarily true?"
emidln 14y ago
When I was taking these sort of tests, I learned to delay processing of non-question text until I've read the question. Reading comprehension, in most of the standardized tests I've taken, was nothing more than ability to quickly pattern match keywords from a question to unstructured data preceding it. This kept me from building models of questions in my head and thusly prevented any preconceived notions or facts divert me from the answer the test considered correct.

CognitiveLens 14y ago

It is a reading comprehension question. Read the text provided: "To avoid crushing the glass slide when focusing, begin with the lens close to the specimen" The microscope lens should initially be placed close to the glass slide: C. To avoid breaking the glass slide when adjusting the focus.

shasta 14y ago
So wait, you're saying the reason for the lens to begin close to the glass is the same reason the lens should begin close to the specimen? How did you come to that conclusion?
- CognitiveLens 14y ago
  Context clues from the "How to" section steps 2-6.
  - shasta 14y ago
    Or you already knew how a microscope works, and performed that step implicitly like the rest of us did.
spamizbad 14y ago
"The microscope lens should initially be placed close to the glass slide: C. To avoid breaking the glass slide when adjusting the focus." Incidentally that statement only sense if you know which direction to turn the focus knob, and you recognize the fact that the hypothetical microscope is capable of crushing the specimen. I had one when I was a kid that was incapable of doing so. I answered the question correctly, but it only due to my cynicism, not my reading comprehension.
- fennecfoxen 14y ago
  Blah blah blah blah. "To avoid crushing the glass slide when focusing, begin with the microscope close to the specimen and then gradually back off to focus." Blah blah blah blah. Utterly incomprehensible!
  - fennecfoxen 14y ago
    And you know what? I'll tell you why people get this wrong. It's because their brains turn off. They say "omg microscopes scary! big block of text!" and guess at answers instead of actually bothering to try and read the text. That's one reason why they get poor scores at reading comprehension: a lack of reading with intent to comprehend. Heck, if they're pressed for time and the guessing-wrong penalty is low enough, it's an entirely rational response. The fact that the journalist is that dense is mostly a symptom of "oh hey I've found an argument against standardized testing to fit my preexisting conceptions of the matter! Screw reading it, it looks complicated, I'll just use it to justify things." Same basic problem.
    - Karunamon 14y ago
      >It's because their brains turn off. They say "omg microscopes scary! big block of text!" s/microscope/computer and you have the cause of an average Helpdesk's stress... ed. Downvotes? Really? Nobody has ever struggled with a problem which could be solved if the help-ee has bothered to read the text on their screen?
      - 14y ago
raganwald 14y ago
I saw that too. It doesn’t change the fact that understanding of the domain strongly biases the result of answering the question. What you’re saying is that it is possible to answer the question while staring bewildered at a device you have never seen or interacted with. What I’m saying is that it is much easier to answer the question if you have hands-on experience. And I think what the author is saying is that we should spend more time giving kids microscopes and testing what they see with them. TANGENT ABOUT BIKE SHED COLOURS: Questions like this remind me of questions about OOP. First the preamble: “Organize objects into classes to create a hierarchy of abstract types....” Then a question: “Classes are used to (a) provide a constructor for objects, (b) to promote reuse of behaviour, (c) to model a type hierarchy, (d) to facilitate modular software development.” You ask someone to build a model in their head, and then the most successful strategy for answering the question is to turn the model off and use brute force to scan the exact words of the question, because the more knowledge you have of the domain, the less likely you are to answer the question correctly from your experience.
- ErrantX 14y ago
  What you’re saying is that it is possible to answer the question while staring bewildered at a device you have never seen or interacted with. Based on my life experience so far; this is one of the most important skills to learn. What I’m saying is that it is much easier to answer the question if you have hands-on experience. Of course; but that isn't the point of the test. And I think what the author is saying is that we should spend more time giving kids microscopes and testing what they see with them. Yes, but again this test is not about that. And if the author is arguing that practical experience should entirely supplant this sort of critical thinking then I entirely disagree. Critical thinking is taught from a young age, in very subtle ways. The ability to approach a topic you know nothing about, dissemble it, and answer a question (either posed to you, or by you) is fundamental to all of our lives.
  - luser001 14y ago
    off topic: i hope you meant 'disassemble' :). 'dissemble' means "to put on a false appearance : conceal facts, intentions, or feelings under some pretense" according to http://www.merriam-webster.com/dictionary/dissemble http://www.merriam-webster.com/dictionary/dissemble.

jellicle 14y ago

> One approach to answering questions like this is to build a little model This test question isn't testing that. > What I’m saying is that answering this question well requires experience with microscopes or similar devices. It sure doesn't. It requires you to be able to read and comprehend text. That's it. The subject could have been Martian fizzbozzles instead of microscopes. > Being able to answer the question without prior knowledge of what a microscope is, or how light behaves, or lenses period, or refracting telescopes, and so forth, is ridiculously hard. It sure isn't. Anyone who can read and comprehend text can answer it with no prior knowledge of the subject.

raganwald 14y ago
My HN friend, my argument was that the writer isn’t daft, and neither is his complaint, and I stand by that. My argument is that the writer raises interesting and useful questions, and I stand by that too. As to the fact that the question doesn’t test internal modelling, of course it does. If you made it a question about something nobody has ever seen before, then it wouldn’t test knowledge of microscopes. But it does ask about microscopes. Perhaps, in aggregate, the test covers enough subject areas that the students tested will be exposed to a roughly equal mix of things they have experience with and things they don’t. But as I noted elsewhere, the fact that it’s possible to answer this question from the text alone in no way changes the fact that it’s easier to answer the question with prior experience. And from that, I think it’s perfectly reasonable to ask whether this is a good question.
- calibraxis 14y ago
  Yes, if it were truly just about reading comprehension, then the test-writers would be horrifically incompetent, and therefore unfit to test anyone. Anyone who competently designs tests (experimenters, pollsters, etc) knows to address such biasing factors. But I think the testers aren't total morons, and know that such a question is biased towards children with proper (privileged) backgrounds where microscopes and the respective training are commonplace. They'll be faster at answering the question and not feel ignorant — crucial advantages on tests. (The testers may not even like this facet of their jobs, like ad industry developers who use ad-blockers, but it sure beats unemployment.) And the whole question smacks of "scientism", where tools are confused with science. You never see a question like, "Scientists have believed something for 200 years. Is it necessarily true?"

emidln 14y ago

When I was taking these sort of tests, I learned to delay processing of non-question text until I've read the question. Reading comprehension, in most of the standardized tests I've taken, was nothing more than ability to quickly pattern match keywords from a question to unstructured data preceding it. This kept me from building models of questions in my head and thusly prevented any preconceived notions or facts divert me from the answer the test considered correct.