4 ms·
I suppose this is just more of a case of ease of use. Personally I think the only realistic / sure fire testing method would be a student sitting down with a p
by duxup 4y ago
I suppose this is just more of a case of ease of use.
Personally I think the only realistic / sure fire testing method would be a student sitting down with a professor and just discussing the material. Q&A, "show me what you know" or even just discussion would work... heck the student might learn more... maybe that's even a path to a better place?
That's assuming we actually want to know / care if the student is learning anything.
- jleyank 4y agoProblem is, this can’t scale. Private tuition, yeah, but there’s huge classes in college environments that would require gobs of proctors. Students wishing to learn will learn. Those wishing scores will get scores. The trick will be detecting the devalued grades.
- flappyeagle 4y agoWTF are they paying 50k/year in tuition for. Maybe put some of that towards proctors
- bradleyjg 4y agoMaybe employers will have to stop freeriding on the degree signal and instead put actual effort into hiring. That would not be a great tragedy in my opinion.
- nullc 4y ago> stop freeriding on the degree signal and instead put actual effort into hiring. 90% of why employers do that is that we functionally outlawed intelligence testing of job applicants, so they instead outsource it to an extremely expensive alternative.
- bradleyjg 4y agoFunctionally is doing all the work there and isn’t accurate. Do a study showing it’s related to job performance and you can go hog wild.
- dragonwriter 4y ago> 90% of why employers do that is that we functionally outlawed intelligence testing of job applicants No, we didn’t, in fact, the ruling that is misrepresented that way has exactly as much effect on degree requirements (insofar as degree rates are also racially disparate) without evidence of job performance need as it does for IQ tests. But, “IQ tests are functionally illegal and degree requirements with no evidentiary basis are fine” is management/HR cargo cult knowledge, which is the real issue.
- alexthehurst 4y agoI dunno, I took an IQ test for a job application in 2016.
- cidergal 4y agoHow is it functionally outlawed? Most places do coding/system design/behavioral interviews to evaluate "merit"/intelligence/ability.
- duxup 4y agoThings gotta change sometimes. Can't pretend work and testing are all genuine and can't pretend we have a clue when it isn't. Maybe it doesn't scale with the current structure, but maybe that needs to change. Granted, I don't pretend that will be easy.
- paulsutter 4y agoIt can scale if it’s a language model that does the testing That is, if testing people for these skills remains useful
- lumost 4y agoI think your underestimating chatgpts utility for students. It’s not just a “do the work for me” tool. It’s a “hey how can I improve this paragraph?”, “why is this true?”, “who first created X”, “If you were a mean TA what would you say about this?” Tool. It wouldn’t surprise me if C students suddenly looked like A students. Their getting proper and timely feedback for the first time.
- ChatGTP 4y ago“why is this true?” It literally tells you in the manual, including the ChatGPT-4 manual, not to use it like this because it will confidently and very convincingly give you false information. I think there are realities and expectations which aren't lining up with this tool, it's absurd. The manual basically tells you not to really use it for anything outside of experimentation. This thing isn't "Data" from Star Trek.
- indymike 4y ago> The manual basically tells you not to really use it for anything outside of experimentation. It is probably a smart move to say GPT4 is not suitable for use for anything. People are already letting GPT4 write things that have legal consequence, and I think this is the best defense when faced with a lawsuit: We told you not to use GPT4 to write your job offer letters and job ads.
- lumost 4y agoIt’s very good however. In the context of academic writing it’s easy to verify when it makes things up. It is also less prone to fabrication on technical topic compared to “write a biography for generic name”
- ChatGTP 4y agoHow would you verify if you don't know the subject matter in the first place?
- duxup 4y agoI wonder how much "make my paragraph better" there is when "do it for me" is just as easy...
- piyh 4y agoChatGPT becomes the test taking interface. Go to a proctored environment and get quizzed by TA-GPT in a socratic test about the subject. Humans review the scores and that's your test result.