3 ms·
Given the usage of LLMs to rank answers to questions, I think testing could shift as well. Having an LLM (operating with good faith prompt, eg trying to genuine
by layoric 2y ago
Given the usage of LLMs to rank answers to questions, I think testing could shift as well. Having an LLM (operating with good faith prompt, eg trying to genuinely discover a level of understanding from a student) have a back and forth with a student to evaluate a level of comprehension of a topic could be more supportive of students than traditional testing.
Validation of the LLM to do such a task reliably would be large undertaking, but seems like something that might be possible in the future.
- irjustin 2y agoThe general issue I have with LLMs in testing is scoring/grading. Since the experience will be different for each test, someone or something will have to grade it individually by reading and "understanding their understanding". It leaves too much to subjectivity.