7 ms·

How do you differentiate between a student who actually understands the topic and one who is just able to produce a convincing essay about it? More generally,

• lukan 2y ago
  "if not by judging the student's output" Where did I say to not do that? And someone who can produce a convincing essay usually has understood the topic (unless he copy pasted it). And when there are doubts, one can ask that student specific questions.
  • Tijdreiziger 2y ago
    > Where did I say to not do that? You asserted that the student should “not just [be] able to produce nice sounding words”. What do you suggest output is if not words (nice sounding or not)? > And someone who can produce a convincing essay usually has understood the topic (unless he copy pasted it). Then, what is the difference between a convincing essay (‘nice sounding words’) produced by a human, and similar words produced by an LLM? After all, even today, students are passing ChatGPT’s work off as their own. Does this then demonstrate understanding by the student or by ChatGPT? > And when there are doubts, one can ask that student specific questions. If an LLM can answer specific questions about a subject, does this demonstrate true understanding? If not, why not?
    • lukan 2y ago
      "If an LLM can answer specific questions about a subject, does this demonstrate true understanding? If not, why not?" If it could, I would say there is understanding. But in every area where I have expertise, I see LLMs failing my questions. Just like a bad student would, who memorized textbooks, but did not connect or process the knowledge in any way.